2024-01-19T04:11:49.155 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T04:11:49.155 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997 --owner scheduled_yuriw@teuthology --name yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/orig.config.yaml 2024-01-19T04:11:49.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:11:49.288 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997 branch: wip-yuri8-testing-2024-01-18-0823 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7520997' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri8-testing-2024-01-18-0823 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 0edf41a622739843d6b978b179ff3227b476dd9d valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 0edf41a622739843d6b978b179ff3227b476dd9d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2024-01-18-0823 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6631 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2024-01-18-0823 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0edf41a622739843d6b978b179ff3227b476dd9d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKl0Q+xC6TnJKR6NvnrNEOAuT+b5nfOqItDsKCd1YHs7HCzF1zWbQmAkVdX8PQKFrvJUEvNLs0gv/l+XFF3Je6k= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuB7JWfd3WQcQkOFKGQLetrP1fsVFkZ2HXq4LEtrduNA9tmMQOkalCgv1HcsK8/Jlr+pnNsg2yBh/cxozRnb1M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-18_21:19:14 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-19T04:11:49.289 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa; will attempt to use it 2024-01-19T04:11:49.289 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks 2024-01-19T04:11:49.290 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-19T04:11:49.292 INFO:teuthology.task.internal:Checking packages... 2024-01-19T04:11:49.316 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0edf41a622739843d6b978b179ff3227b476dd9d' 2024-01-19T04:11:49.316 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-19T04:11:49.316 INFO:teuthology.packaging:ref: None 2024-01-19T04:11:49.317 INFO:teuthology.packaging:tag: None 2024-01-19T04:11:49.317 INFO:teuthology.packaging:branch: wip-yuri8-testing-2024-01-18-0823 2024-01-19T04:11:49.317 INFO:teuthology.packaging:sha1: 0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:11:49.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri8-testing-2024-01-18-0823 2024-01-19T04:11:49.534 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:11:49.536 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-19T04:11:49.548 INFO:teuthology.task.internal:no buildpackages task found 2024-01-19T04:11:49.548 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-19T04:11:49.560 INFO:teuthology.task.internal:Saving configuration 2024-01-19T04:11:49.582 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-19T04:11:49.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T04:11:49.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:06:04.822761', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJOZA1+Wpxc2NKE0K4sWN9HAXERlpCNNBDkrzbgcG/qB'} 2024-01-19T04:11:49.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:06:04.821335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHNIO7cj2CCrV45GZJmeqf3sXmbO5Mq4DC6Tof4KBXs5'} 2024-01-19T04:11:49.632 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-19T04:11:49.638 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-19T04:11:49.638 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-19T04:11:49.638 INFO:teuthology.run_tasks:Running task console_log... 2024-01-19T04:11:49.707 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f749c2ea430>, signals=[15]) 2024-01-19T04:11:49.707 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-19T04:11:49.714 INFO:teuthology.task.internal:Opening connections... 2024-01-19T04:11:49.714 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:11:49.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:11:49.796 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T04:11:49.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:11:49.873 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-19T04:11:49.880 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-01-19T04:11:49.885 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-01-19T04:11:49.885 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04" 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-19T04:11:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-19T04:11:49.932 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-19T04:11:49.932 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-19T04:11:49.932 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy 2024-01-19T04:11:49.932 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-19T04:11:49.953 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-01-19T04:11:49.957 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-01-19T04:11:49.957 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-01-19T04:11:50.003 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-19T04:11:50.003 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2024-01-19T04:11:50.003 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="22.04" 2024-01-19T04:11:50.003 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-19T04:11:50.003 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=jammy 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-19T04:11:50.004 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=jammy 2024-01-19T04:11:50.004 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-01-19T04:11:50.028 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-19T04:11:50.036 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-19T04:11:50.041 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-19T04:11:50.041 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-01-19T04:11:50.044 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2024-01-19T04:11:50.050 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-19T04:11:50.055 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-19T04:11:50.055 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-01-19T04:11:50.089 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2024-01-19T04:11:50.102 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-19T04:11:50.151 INFO:teuthology.run_tasks:Running task kernel... 2024-01-19T04:11:50.165 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-19T04:11:50.165 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-19T04:11:50.165 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-19T04:11:50.165 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-19T04:11:50.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:11:50.170 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-01-19T04:11:50.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:11:50.171 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2024-01-19T04:11:50.215 INFO:teuthology.orchestra.run.smithi133.stdout:5.15.0-56-generic 2024-01-19T04:11:50.215 INFO:teuthology.task.kernel:Running kernel on smithi133: 5.15.0-56-generic 2024-01-19T04:11:50.216 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2024-01-19T04:11:50.219 INFO:teuthology.orchestra.run.smithi156.stdout:5.15.0-56-generic 2024-01-19T04:11:50.219 INFO:teuthology.task.kernel:Running kernel on smithi156: 5.15.0-56-generic 2024-01-19T04:11:50.219 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get clean 2024-01-19T04:11:50.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2024-01-19T04:11:50.342 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2024-01-19T04:11:50.481 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:11:50.481 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-01-19T04:11:50.482 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-01-19T04:11:50.485 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-01-19T04:11:50.570 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-01-19T04:11:50.595 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:11:50.677 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-01-19T04:11:50.708 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,065 kB] 2024-01-19T04:11:50.719 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,065 kB] 2024-01-19T04:11:50.789 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,282 kB] 2024-01-19T04:11:50.814 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [386 kB] 2024-01-19T04:11:50.820 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [201 kB] 2024-01-19T04:11:50.821 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [386 kB] 2024-01-19T04:11:50.824 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-01-19T04:11:50.824 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,248 kB] 2024-01-19T04:11:50.828 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [201 kB] 2024-01-19T04:11:50.836 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-01-19T04:11:50.836 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.8 kB] 2024-01-19T04:11:50.837 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,248 kB] 2024-01-19T04:11:50.853 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.8 kB] 2024-01-19T04:11:50.853 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [204 kB] 2024-01-19T04:11:50.858 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T04:11:50.858 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [831 kB] 2024-01-19T04:11:50.861 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [204 kB] 2024-01-19T04:11:50.865 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T04:11:50.865 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [831 kB] 2024-01-19T04:11:50.877 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [585 kB] 2024-01-19T04:11:50.886 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [158 kB] 2024-01-19T04:11:50.887 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [585 kB] 2024-01-19T04:11:50.887 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-01-19T04:11:50.892 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-01-19T04:11:50.893 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [158 kB] 2024-01-19T04:11:50.893 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-01-19T04:11:50.895 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-01-19T04:11:50.895 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-01-19T04:11:50.913 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-01-19T04:11:50.917 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [552 kB] 2024-01-19T04:11:50.917 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-01-19T04:11:50.917 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-01-19T04:11:50.919 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-01-19T04:11:50.920 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [262 kB] 2024-01-19T04:11:50.922 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-01-19T04:11:50.923 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-01-19T04:11:50.923 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [33.2 kB] 2024-01-19T04:11:50.924 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,276 kB] 2024-01-19T04:11:50.949 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [208 kB] 2024-01-19T04:11:50.951 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T04:11:50.951 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [681 kB] 2024-01-19T04:11:50.958 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,032 kB] 2024-01-19T04:11:50.968 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [231 kB] 2024-01-19T04:11:50.970 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-01-19T04:11:50.970 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-01-19T04:11:50.971 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-01-19T04:11:50.971 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-01-19T04:11:50.986 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-01-19T04:11:50.986 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.7 kB] 2024-01-19T04:11:50.986 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.9 kB] 2024-01-19T04:11:50.987 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-01-19T04:11:51.005 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-01-19T04:11:51.005 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2024-01-19T04:11:51.006 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2024-01-19T04:11:51.006 INFO:teuthology.orchestra.run.smithi156.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-01-19T04:11:51.006 INFO:teuthology.orchestra.run.smithi156.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-01-19T04:11:51.038 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-01-19T04:11:51.176 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,282 kB] 2024-01-19T04:11:51.461 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [552 kB] 2024-01-19T04:11:51.500 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [262 kB] 2024-01-19T04:11:51.516 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-01-19T04:11:51.517 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [33.2 kB] 2024-01-19T04:11:51.519 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,276 kB] 2024-01-19T04:11:51.574 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [208 kB] 2024-01-19T04:11:51.580 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T04:11:51.745 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,032 kB] 2024-01-19T04:11:52.374 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [681 kB] 2024-01-19T04:11:52.412 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [231 kB] 2024-01-19T04:11:52.424 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-01-19T04:11:52.425 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-01-19T04:11:52.428 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-01-19T04:11:52.428 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-01-19T04:11:52.429 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-01-19T04:11:52.429 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.7 kB] 2024-01-19T04:11:52.456 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.9 kB] 2024-01-19T04:11:52.459 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-01-19T04:11:52.623 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-01-19T04:11:52.706 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2024-01-19T04:11:52.791 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2024-01-19T04:11:52.872 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-01-19T04:11:52.906 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-01-19T04:11:56.379 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 11.0 MB in 2s (6,905 kB/s) 2024-01-19T04:11:57.293 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 11.0 MB in 3s (4,383 kB/s) 2024-01-19T04:11:57.676 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:11:57.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T04:11:57.743 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:11:57.912 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2024-01-19T04:11:57.913 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2024-01-19T04:11:58.055 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:11:58.056 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:11:58.056 INFO:teuthology.orchestra.run.smithi156.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:11:58.056 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:11:58.056 INFO:teuthology.orchestra.run.smithi156.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-19T04:11:58.056 INFO:teuthology.orchestra.run.smithi156.stdout: python2.7-minimal 2024-01-19T04:11:58.057 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:11:58.057 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2024-01-19T04:11:58.057 INFO:teuthology.orchestra.run.smithi156.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T04:11:58.058 INFO:teuthology.orchestra.run.smithi156.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2024-01-19T04:11:58.058 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2024-01-19T04:11:58.059 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2024-01-19T04:11:58.059 INFO:teuthology.orchestra.run.smithi156.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-01-19T04:11:58.059 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2024-01-19T04:11:58.059 INFO:teuthology.orchestra.run.smithi156.stdout: thermald 2024-01-19T04:11:58.111 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2024-01-19T04:11:58.111 INFO:teuthology.orchestra.run.smithi156.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T04:11:58.112 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2024-01-19T04:11:58.112 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-extra-5.15.0-91-generic 2024-01-19T04:11:58.113 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2024-01-19T04:11:58.113 INFO:teuthology.orchestra.run.smithi156.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-19T04:11:58.291 INFO:teuthology.orchestra.run.smithi156.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T04:11:58.291 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 113 MB of archives. 2024-01-19T04:11:58.291 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 582 MB of additional disk space will be used. 2024-01-19T04:11:58.291 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2024-01-19T04:11:58.616 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:11:58.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T04:11:58.694 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:11:58.866 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-01-19T04:11:58.866 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-01-19T04:11:59.012 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:11:59.012 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:11:59.012 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:11:59.012 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:11:59.013 INFO:teuthology.orchestra.run.smithi133.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-19T04:11:59.013 INFO:teuthology.orchestra.run.smithi133.stdout: python2.7-minimal 2024-01-19T04:11:59.013 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:11:59.014 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2024-01-19T04:11:59.014 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T04:11:59.014 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2024-01-19T04:11:59.014 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2024-01-19T04:11:59.015 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2024-01-19T04:11:59.015 INFO:teuthology.orchestra.run.smithi133.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-01-19T04:11:59.015 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2024-01-19T04:11:59.015 INFO:teuthology.orchestra.run.smithi133.stdout: thermald 2024-01-19T04:11:59.054 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2024-01-19T04:11:59.054 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T04:11:59.055 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2024-01-19T04:11:59.055 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-extra-5.15.0-91-generic 2024-01-19T04:11:59.056 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2024-01-19T04:11:59.056 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-19T04:11:59.112 INFO:teuthology.orchestra.run.smithi133.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T04:11:59.112 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 113 MB of archives. 2024-01-19T04:11:59.113 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 582 MB of additional disk space will be used. 2024-01-19T04:11:59.113 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2024-01-19T04:11:59.592 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2024-01-19T04:11:59.667 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2024-01-19T04:11:59.699 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2024-01-19T04:12:00.067 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2024-01-19T04:12:00.597 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2024-01-19T04:12:00.598 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2024-01-19T04:12:00.598 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2024-01-19T04:12:00.717 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2024-01-19T04:12:00.739 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2024-01-19T04:12:01.120 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 113 MB in 2s (67.4 MB/s) 2024-01-19T04:12:01.278 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2024-01-19T04:12:02.175 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2024-01-19T04:12:02.176 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2024-01-19T04:12:02.176 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2024-01-19T04:12:02.808 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2024-01-19T04:12:02.897 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2024-01-19T04:12:03.253 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-01-19T04:12:03.259 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:03.293 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 113 MB in 5s (23.6 MB/s) 2024-01-19T04:12:03.450 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:03.458 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2024-01-19T04:12:05.409 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-01-19T04:12:05.414 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:05.481 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:05.859 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2024-01-19T04:12:05.880 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:05.976 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:06.461 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2024-01-19T04:12:06.482 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:06.519 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:07.507 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2024-01-19T04:12:07.528 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:07.616 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:08.052 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2024-01-19T04:12:08.073 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:08.101 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:12.859 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T04:12:12.986 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T04:12:13.335 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T04:12:13.447 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T04:12:13.717 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2024-01-19T04:12:13.740 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2024-01-19T04:12:13.783 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T04:12:14.914 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T04:12:15.049 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T04:12:15.382 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T04:12:15.503 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T04:12:15.848 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2024-01-19T04:12:15.870 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2024-01-19T04:12:15.914 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T04:12:19.305 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2024-01-19T04:12:19.341 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:19.379 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:21.875 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2024-01-19T04:12:21.911 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T04:12:21.941 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:22.465 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T04:12:22.590 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T04:12:22.920 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T04:12:23.036 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:23.162 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2024-01-19T04:12:23.283 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:24.566 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T04:12:24.583 INFO:teuthology.orchestra.run.smithi133.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:12:24.584 INFO:teuthology.orchestra.run.smithi133.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-01-19T04:12:24.584 INFO:teuthology.orchestra.run.smithi133.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2024-01-19T04:12:24.584 INFO:teuthology.orchestra.run.smithi133.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:24.689 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T04:12:24.743 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:25.031 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T04:12:25.153 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:25.287 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2024-01-19T04:12:25.416 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:26.678 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2024-01-19T04:12:26.737 INFO:teuthology.orchestra.run.smithi156.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:12:26.737 INFO:teuthology.orchestra.run.smithi156.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-01-19T04:12:26.737 INFO:teuthology.orchestra.run.smithi156.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2024-01-19T04:12:26.737 INFO:teuthology.orchestra.run.smithi156.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:26.778 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:26.902 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:28.139 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-generic (5.15.0.91.88) ... 2024-01-19T04:12:28.265 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:28.332 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-19T04:12:28.332 INFO:teuthology.orchestra.run.smithi133.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:28.344 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2024-01-19T04:12:28.470 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:29.847 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-generic (5.15.0.91.88) ... 2024-01-19T04:12:29.973 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T04:12:30.039 INFO:teuthology.orchestra.run.smithi156.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-19T04:12:30.040 INFO:teuthology.orchestra.run.smithi156.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:42.940 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-19T04:12:42.940 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub' 2024-01-19T04:12:42.951 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:12:42.967 INFO:teuthology.orchestra.run.smithi133.stdout:Generating grub configuration file ... 2024-01-19T04:12:43.285 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T04:12:43.305 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:43.683 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:12:43.688 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:12:43.760 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:12:43.766 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:12:43.920 INFO:teuthology.orchestra.run.smithi133.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:12:43.920 INFO:teuthology.orchestra.run.smithi133.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:12:43.920 INFO:teuthology.orchestra.run.smithi133.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:12:43.963 INFO:teuthology.orchestra.run.smithi133.stdout:done 2024-01-19T04:12:43.986 INFO:teuthology.orchestra.run.smithi156.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-19T04:12:43.987 INFO:teuthology.orchestra.run.smithi156.stdout:Sourcing file `/etc/default/grub' 2024-01-19T04:12:44.006 INFO:teuthology.orchestra.run.smithi156.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:12:44.022 INFO:teuthology.orchestra.run.smithi156.stdout:Generating grub configuration file ... 2024-01-19T04:12:44.290 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T04:12:44.308 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:44.457 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2024-01-19T04:12:44.483 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 20 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.15.0.91.88 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2024-01-19T04:12:44.484 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2024-01-19T04:12:44.485 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2024-01-19T04:12:44.485 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2024-01-19T04:12:44.485 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-19T04:12:44.485 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-19T04:12:44.485 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-19T04:12:44.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2024-01-19T04:12:44.485 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2024-01-19T04:12:44.614 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:12:44.620 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:12:44.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2024-01-19T04:12:44.685 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:12:44.691 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:12:44.829 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T04:12:44.867 INFO:teuthology.orchestra.run.smithi156.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:12:44.867 INFO:teuthology.orchestra.run.smithi156.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:12:44.868 INFO:teuthology.orchestra.run.smithi156.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:12:44.904 INFO:teuthology.orchestra.run.smithi156.stdout:done 2024-01-19T04:12:44.921 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:12:45.003 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T04:12:45.084 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T04:12:45.394 DEBUG:teuthology.orchestra.run.smithi156:> dpkg -s linux-image-generic 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Package: linux-image-generic 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Status: install ok installed 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Priority: optional 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Section: kernel 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Installed-Size: 20 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: amd64 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Source: linux-meta 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Version: 5.15.0.91.88 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T04:12:45.422 INFO:teuthology.orchestra.run.smithi156.stdout:Recommends: thermald 2024-01-19T04:12:45.423 INFO:teuthology.orchestra.run.smithi156.stdout:Description: Generic Linux kernel image 2024-01-19T04:12:45.423 INFO:teuthology.orchestra.run.smithi156.stdout: This package will always depend on the latest generic kernel image 2024-01-19T04:12:45.423 INFO:teuthology.orchestra.run.smithi156.stdout: available. 2024-01-19T04:12:45.423 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2024-01-19T04:12:45.423 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-19T04:12:45.423 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-19T04:12:45.423 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-19T04:12:45.423 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2024-01-19T04:12:45.423 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get clean 2024-01-19T04:12:45.606 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2024-01-19T04:12:45.720 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T04:12:45.720 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:12:45.734 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T04:12:45.755 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T04:12:46.165 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:12:46.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T04:12:46.233 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:12:46.401 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-01-19T04:12:46.402 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-01-19T04:12:46.552 INFO:teuthology.orchestra.run.smithi133.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2024-01-19T04:12:46.552 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:12:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:12:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:12:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:12:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:12:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:12:46.553 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:12:46.590 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T04:12:46.592 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2024-01-19T04:12:46.645 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2024-01-19T04:12:46.645 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2024-01-19T04:12:46.645 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 20 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.15.0.91.88 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2024-01-19T04:12:46.646 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2024-01-19T04:12:46.647 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-01-19T04:12:46.690 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.k55p0c3GVs 2024-01-19T04:12:46.690 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub/grub.cfg /tmp/tmp.k55p0c3GVs 2024-01-19T04:12:46.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.k55p0c3GVs 2024-01-19T04:12:46.851 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.k55p0c3GVs is 10KB 2024-01-19T04:12:46.864 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.k55p0c3GVs 2024-01-19T04:12:46.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-19T04:12:46.919 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:12:46.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-19T04:12:46.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-19T04:12:46.998 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:12:47.002 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2024-01-19T04:12:47.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo update-grub 2024-01-19T04:12:47.016 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T04:12:47.075 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:12:47.247 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2024-01-19T04:12:47.247 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2024-01-19T04:12:47.395 INFO:teuthology.orchestra.run.smithi156.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2024-01-19T04:12:47.396 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:12:47.396 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:12:47.396 INFO:teuthology.orchestra.run.smithi156.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:12:47.396 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:12:47.396 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:12:47.396 INFO:teuthology.orchestra.run.smithi156.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:12:47.397 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:12:47.431 INFO:teuthology.orchestra.run.smithi156.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T04:12:47.433 DEBUG:teuthology.orchestra.run.smithi156:> dpkg -s linux-image-generic 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Package: linux-image-generic 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Status: install ok installed 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Priority: optional 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Section: kernel 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Installed-Size: 20 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: amd64 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Source: linux-meta 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Version: 5.15.0.91.88 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T04:12:47.449 INFO:teuthology.orchestra.run.smithi156.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T04:12:47.450 INFO:teuthology.orchestra.run.smithi156.stdout:Recommends: thermald 2024-01-19T04:12:47.450 INFO:teuthology.orchestra.run.smithi156.stdout:Description: Generic Linux kernel image 2024-01-19T04:12:47.450 INFO:teuthology.orchestra.run.smithi156.stdout: This package will always depend on the latest generic kernel image 2024-01-19T04:12:47.450 INFO:teuthology.orchestra.run.smithi156.stdout: available. 2024-01-19T04:12:47.450 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-01-19T04:12:47.494 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.aVySY23Ckn 2024-01-19T04:12:47.494 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub/grub.cfg /tmp/tmp.aVySY23Ckn 2024-01-19T04:12:47.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.aVySY23Ckn 2024-01-19T04:12:47.674 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.aVySY23Ckn is 10KB 2024-01-19T04:12:47.686 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.aVySY23Ckn 2024-01-19T04:12:47.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-19T04:12:47.746 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:12:47.746 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-19T04:12:47.746 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-19T04:12:47.819 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2024-01-19T04:12:47.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo update-grub 2024-01-19T04:12:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2024-01-19T04:12:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:12:48.221 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-01-19T04:12:48.471 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T04:12:48.477 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:48.770 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:12:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:12:48.818 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:12:48.823 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:12:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:12:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:12:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:12:48.962 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-01-19T04:12:48.972 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-01-19T04:12:48.993 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub' 2024-01-19T04:12:48.995 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:12:48.996 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2024-01-19T04:12:49.172 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T04:12:49.177 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T04:12:49.428 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:12:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:12:49.469 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:12:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:12:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:12:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:12:49.597 INFO:teuthology.orchestra.run.smithi156.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:12:49.624 INFO:teuthology.orchestra.run.smithi156.stderr:done 2024-01-19T04:12:49.635 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2024-01-19T04:13:18.980 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-19T04:13:18.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:13:18.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:13:19.639 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-19T04:13:19.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:13:19.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:13:37.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-19T04:13:46.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:13:46.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:13:49.532 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-19T04:13:54.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-01-19T04:14:01.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:14:01.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:14:03.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:14:03.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:14:19.964 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-19T04:14:21.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-01-19T04:14:33.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:14:33.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:14:33.504 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-01-19T04:14:34.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:14:34.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:14:35.293 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-19T04:14:35.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:14:35.901 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-91-generic"... 2024-01-19T04:14:35.901 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-01-19T04:14:35.948 INFO:teuthology.orchestra.run.smithi133.stdout:5.15.0-91-generic 2024-01-19T04:14:35.948 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2024-01-19T04:14:35.948 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-19T04:14:35.948 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-19T04:14:36.949 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-19T04:14:36.950 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-19T04:14:37.293 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2024-01-19T04:14:37.314 DEBUG:teuthology.parallel:result is None 2024-01-19T04:14:48.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:14:48.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:14:48.863 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-01-19T04:14:49.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:14:49.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-91-generic"... 2024-01-19T04:14:49.465 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2024-01-19T04:14:49.512 INFO:teuthology.orchestra.run.smithi156.stdout:5.15.0-91-generic 2024-01-19T04:14:49.512 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2024-01-19T04:14:49.512 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-19T04:14:49.512 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-19T04:14:50.513 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-19T04:14:50.513 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-19T04:14:50.579 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2024-01-19T04:14:50.605 DEBUG:teuthology.parallel:result is None 2024-01-19T04:14:50.605 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-19T04:14:50.615 INFO:teuthology.task.internal:Creating test directory... 2024-01-19T04:14:50.615 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-19T04:14:50.617 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-19T04:14:50.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-19T04:14:50.631 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-19T04:14:50.642 INFO:teuthology.task.internal:Creating archive directory... 2024-01-19T04:14:50.642 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-19T04:14:50.665 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-19T04:14:50.738 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-19T04:14:50.746 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-19T04:14:50.746 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-19T04:14:50.749 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-19T04:14:50.767 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:14:50.770 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:14:50.775 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:14:50.778 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:14:50.780 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-19T04:14:50.786 INFO:teuthology.task.internal:Configuring sudo... 2024-01-19T04:14:50.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-19T04:14:50.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-19T04:14:50.836 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-19T04:14:50.845 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-19T04:14:50.845 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-19T04:14:50.881 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-19T04:14:50.886 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-19T04:14:50.932 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-19T04:14:50.980 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:14:50.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-19T04:14:51.040 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-19T04:14:51.046 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-19T04:14:51.092 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:14:51.092 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-19T04:14:51.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-01-19T04:14:51.159 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2024-01-19T04:14:51.233 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-19T04:14:51.241 INFO:teuthology.task.internal:Starting timer... 2024-01-19T04:14:51.241 INFO:teuthology.run_tasks:Running task pcp... 2024-01-19T04:14:51.252 INFO:teuthology.run_tasks:Running task selinux... 2024-01-19T04:14:51.261 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2024-01-19T04:14:51.261 DEBUG:teuthology.task.selinux:Excluding smithi156: OS 'ubuntu' does not support SELinux 2024-01-19T04:14:51.261 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-19T04:14:51.261 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-19T04:14:51.262 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-19T04:14:51.262 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-19T04:14:51.270 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-19T04:14:51.286 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-19T04:14:51.287 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-19T04:21:32.678 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2024-01-19T04:21:32.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:21:32.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:21:32.763 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-19T04:21:32.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-19T04:21:32.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:21:32.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:21:32.925 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-01-19T04:21:33.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-01-19T04:21:33.000 INFO:teuthology.run_tasks:Running task clock... 2024-01-19T04:21:33.012 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-19T04:21:33.012 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-19T04:21:33.012 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T04:21:33.015 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-19T04:21:33.015 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T04:21:33.042 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-19T04:21:33.042 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Command line: ntpd -gq 2024-01-19T04:21:33.042 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: ---------------------------------------------------- 2024-01-19T04:21:33.042 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: ntp-4 is maintained by Network Time Foundation, 2024-01-19T04:21:33.043 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-19T04:21:33.043 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: corporation. Support and training for ntp-4 are 2024-01-19T04:21:33.043 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: available at https://www.nwtime.org/support 2024-01-19T04:21:33.043 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: ---------------------------------------------------- 2024-01-19T04:21:33.044 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: proto: precision = 0.044 usec (-24) 2024-01-19T04:21:33.044 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: basedate set to 2022-02-04 2024-01-19T04:21:33.044 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: gps base set to 2022-02-06 (week 2196) 2024-01-19T04:21:33.044 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:21:33.044 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:21:33.045 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listen and drop on 0 v6wildcard [::]:123 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listen normally on 2 lo 127.0.0.1:123 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listen normally on 4 lo [::1]:123 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2024-01-19T04:21:33.046 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:33 ntpd[16830]: Listening on routing socket on fd #22 for interface updates 2024-01-19T04:21:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-19T04:21:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Command line: ntpd -gq 2024-01-19T04:21:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: ---------------------------------------------------- 2024-01-19T04:21:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: ntp-4 is maintained by Network Time Foundation, 2024-01-19T04:21:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-19T04:21:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: corporation. Support and training for ntp-4 are 2024-01-19T04:21:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: available at https://www.nwtime.org/support 2024-01-19T04:21:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: ---------------------------------------------------- 2024-01-19T04:21:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: proto: precision = 0.046 usec (-24) 2024-01-19T04:21:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: basedate set to 2022-02-04 2024-01-19T04:21:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: gps base set to 2022-02-06 (week 2196) 2024-01-19T04:21:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:21:33.075 INFO:teuthology.orchestra.run.smithi156.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:21:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:21:33.076 INFO:teuthology.orchestra.run.smithi156.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:21:33.076 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listen and drop on 0 v6wildcard [::]:123 2024-01-19T04:21:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-19T04:21:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listen normally on 2 lo 127.0.0.1:123 2024-01-19T04:21:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listen normally on 3 enp3s0f1 172.21.15.156:123 2024-01-19T04:21:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listen normally on 4 lo [::1]:123 2024-01-19T04:21:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6dfd%5]:123 2024-01-19T04:21:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:33 ntpd[16841]: Listening on routing socket on fd #22 for interface updates 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:34.045 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:34.045 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:34.045 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:34 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:34.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:34 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:34.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:34 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:35 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:35 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:35 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:35 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:35 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:35 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:35.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:35 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:35.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:35 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:35.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:35 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:35.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:35 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:35.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:35 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:35.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:35 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:36 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:36 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:36 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:36 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:36 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:36 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:36.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:36 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:37 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:37 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:37 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:37 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:37 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:37 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:37.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:37 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:38.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:38.045 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:38.045 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:38 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:38.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:38 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:38.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:38 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:38.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:38 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:38.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:38 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:38.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:38 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:38.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:38 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:39 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:39 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:39 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:39 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:39 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:39 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:39.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:39.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:39.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:39.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:39 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:40.044 INFO:teuthology.orchestra.run.smithi133.stdout:19 Jan 04:21:40 ntpd[16830]: ntpd: time slew -0.000657 s 2024-01-19T04:21:40.044 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew -0.000657s 2024-01-19T04:21:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-19T04:21:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:19 Jan 04:21:40 ntpd[16830]: can't open /var/log/ntpstats/loopstats.20240119: Permission denied 2024-01-19T04:21:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:40 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:40 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:40 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:40 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:40 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:40 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:40.099 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T04:21:40.099 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2024-01-19T04:21:40.099 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:40.099 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:40.099 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:40.099 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stdout:19 Jan 04:21:41 ntpd[16841]: ntpd: time slew +0.000092 s 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stdout:ntpd: time slew +0.000092s 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-19T04:21:41.075 INFO:teuthology.orchestra.run.smithi156.stderr:19 Jan 04:21:41 ntpd[16841]: can't open /var/log/ntpstats/loopstats.20240119: Permission denied 2024-01-19T04:21:41.186 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T04:21:41.186 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2024-01-19T04:21:41.186 INFO:teuthology.orchestra.run.smithi156.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:41.186 INFO:teuthology.orchestra.run.smithi156.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:41.186 INFO:teuthology.orchestra.run.smithi156.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:41.186 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:21:41.187 INFO:teuthology.run_tasks:Running task install... 2024-01-19T04:21:41.196 DEBUG:teuthology.task.install:project ceph 2024-01-19T04:21:41.196 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}} 2024-01-19T04:21:41.196 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'} 2024-01-19T04:21:41.196 INFO:teuthology.task.install:Using flavor: default 2024-01-19T04:21:41.202 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-19T04:21:41.202 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-19T04:21:41.202 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2024-01-19T04:21:41.203 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-key list | grep Ceph 2024-01-19T04:21:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-19T04:21:41.283 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-19T04:21:41.291 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-19T04:21:41.291 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2024-01-19T04:21:41.292 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-19T04:21:41.293 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-19T04:21:41.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:21:41.309 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-19T04:21:41.310 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph.com (release key) 2024-01-19T04:21:41.310 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-19T04:21:41.310 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-19T04:21:41.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:21:41.465 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-19T04:21:41.465 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:21:41.509 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-19T04:21:41.510 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:21:41.578 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:21:41.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-19T04:21:41.592 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2024-01-19T04:21:41.618 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:21:41.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-19T04:21:41.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2024-01-19T04:21:41.763 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:21:41.763 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T04:21:41.777 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T04:21:41.797 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T04:21:41.872 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-19T04:21:41.909 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-19T04:21:41.917 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-19T04:21:41.933 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:21:41.933 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T04:21:41.945 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-19T04:21:41.953 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-19T04:21:41.982 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-19T04:21:41.990 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-19T04:21:42.004 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T04:21:42.023 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-19T04:21:42.027 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-19T04:21:42.070 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-19T04:21:42.085 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T04:21:42.102 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 28.9 kB in 0s (86.1 kB/s) 2024-01-19T04:21:42.305 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 28.9 kB in 0s (59.0 kB/s) 2024-01-19T04:21:43.046 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:21:43.061 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy ceph-common-dbg=19.0.0-766-g0edf41a6-1jammy ceph-fuse-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mds-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mgr-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mon-dbg=19.0.0-766-g0edf41a6-1jammy ceph-osd-dbg=19.0.0-766-g0edf41a6-1jammy ceph-test-dbg=19.0.0-766-g0edf41a6-1jammy libcephfs2-dbg=19.0.0-766-g0edf41a6-1jammy librados2-dbg=19.0.0-766-g0edf41a6-1jammy libradosstriper1-dbg=19.0.0-766-g0edf41a6-1jammy librbd1-dbg=19.0.0-766-g0edf41a6-1jammy librgw2-dbg=19.0.0-766-g0edf41a6-1jammy radosgw-dbg=19.0.0-766-g0edf41a6-1jammy rbd-fuse-dbg=19.0.0-766-g0edf41a6-1jammy rbd-mirror-dbg=19.0.0-766-g0edf41a6-1jammy rbd-nbd-dbg=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:21:43.127 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:21:43.256 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:21:43.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy ceph-common-dbg=19.0.0-766-g0edf41a6-1jammy ceph-fuse-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mds-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mgr-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mon-dbg=19.0.0-766-g0edf41a6-1jammy ceph-osd-dbg=19.0.0-766-g0edf41a6-1jammy ceph-test-dbg=19.0.0-766-g0edf41a6-1jammy libcephfs2-dbg=19.0.0-766-g0edf41a6-1jammy librados2-dbg=19.0.0-766-g0edf41a6-1jammy libradosstriper1-dbg=19.0.0-766-g0edf41a6-1jammy librbd1-dbg=19.0.0-766-g0edf41a6-1jammy librgw2-dbg=19.0.0-766-g0edf41a6-1jammy radosgw-dbg=19.0.0-766-g0edf41a6-1jammy rbd-fuse-dbg=19.0.0-766-g0edf41a6-1jammy rbd-mirror-dbg=19.0.0-766-g0edf41a6-1jammy rbd-nbd-dbg=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:21:43.323 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2024-01-19T04:21:43.324 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2024-01-19T04:21:43.329 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:21:43.502 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:21:43.503 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:21:43.503 INFO:teuthology.orchestra.run.smithi156.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:21:43.503 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:21:43.503 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T04:21:43.504 INFO:teuthology.orchestra.run.smithi156.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-19T04:21:43.505 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-19T04:21:43.505 INFO:teuthology.orchestra.run.smithi156.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-19T04:21:43.506 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-19T04:21:43.507 INFO:teuthology.orchestra.run.smithi156.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-19T04:21:43.508 INFO:teuthology.orchestra.run.smithi156.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-19T04:21:43.508 INFO:teuthology.orchestra.run.smithi156.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-19T04:21:43.508 INFO:teuthology.orchestra.run.smithi156.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-19T04:21:43.508 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2024-01-19T04:21:43.508 INFO:teuthology.orchestra.run.smithi156.stdout: btrfs-tools 2024-01-19T04:21:43.512 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-01-19T04:21:43.512 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-19T04:21:43.638 INFO:teuthology.orchestra.run.smithi156.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-19T04:21:43.639 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-19T04:21:43.640 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-19T04:21:43.686 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:21:43.686 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:21:43.686 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:21:43.687 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:21:43.687 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:21:43.687 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:21:43.687 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:21:43.688 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2024-01-19T04:21:43.688 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-19T04:21:43.688 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-19T04:21:43.689 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T04:21:43.689 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-19T04:21:43.689 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-19T04:21:43.689 INFO:teuthology.orchestra.run.smithi133.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-19T04:21:43.690 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-19T04:21:43.691 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-19T04:21:43.692 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-19T04:21:43.692 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2024-01-19T04:21:43.692 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2024-01-19T04:21:43.704 INFO:teuthology.orchestra.run.smithi156.stdout:0 upgraded, 142 newly installed, 0 to remove and 266 not upgraded. 2024-01-19T04:21:43.704 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 3,660 MB of archives. 2024-01-19T04:21:43.705 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 4,455 MB of additional disk space will be used. 2024-01-19T04:21:43.705 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-19T04:21:43.726 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-19T04:21:43.737 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-19T04:21:43.787 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-19T04:21:43.812 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-19T04:21:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-19T04:21:43.819 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2024-01-19T04:21:43.819 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-19T04:21:43.819 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-19T04:21:43.819 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-19T04:21:43.820 INFO:teuthology.orchestra.run.smithi133.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-19T04:21:43.821 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-19T04:21:43.822 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-19T04:21:43.829 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-19T04:21:43.858 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-19T04:21:43.886 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-19T04:21:43.886 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 142 newly installed, 0 to remove and 266 not upgraded. 2024-01-19T04:21:43.887 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 3,660 MB of archives. 2024-01-19T04:21:43.887 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 4,455 MB of additional disk space will be used. 2024-01-19T04:21:43.887 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-19T04:21:43.890 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-19T04:21:43.902 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-19T04:21:43.906 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-19T04:21:43.906 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-19T04:21:43.908 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-19T04:21:43.914 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-19T04:21:43.916 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-19T04:21:43.918 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-19T04:21:43.919 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-19T04:21:43.920 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-19T04:21:43.920 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-19T04:21:43.930 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-19T04:21:43.933 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-19T04:21:43.934 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-19T04:21:43.935 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-19T04:21:43.951 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-19T04:21:43.952 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-19T04:21:43.952 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-19T04:21:43.953 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-19T04:21:43.953 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-19T04:21:43.953 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-19T04:21:43.961 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-19T04:21:43.968 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-19T04:21:43.973 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-19T04:21:43.973 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-19T04:21:43.976 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-19T04:21:43.976 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-19T04:21:43.992 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-19T04:21:43.994 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-19T04:21:43.994 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-19T04:21:43.996 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-19T04:21:43.997 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-19T04:21:43.997 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-19T04:21:43.997 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-19T04:21:43.999 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-19T04:21:44.012 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-19T04:21:44.015 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-19T04:21:44.016 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-19T04:21:44.025 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-19T04:21:44.026 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-19T04:21:44.035 INFO:teuthology.orchestra.run.smithi156.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-19T04:21:44.037 INFO:teuthology.orchestra.run.smithi156.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-19T04:21:44.039 INFO:teuthology.orchestra.run.smithi156.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-19T04:21:44.043 INFO:teuthology.orchestra.run.smithi156.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-19T04:21:44.044 INFO:teuthology.orchestra.run.smithi156.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-19T04:21:44.046 INFO:teuthology.orchestra.run.smithi156.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-19T04:21:44.064 INFO:teuthology.orchestra.run.smithi156.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-19T04:21:44.068 INFO:teuthology.orchestra.run.smithi156.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-19T04:21:44.069 INFO:teuthology.orchestra.run.smithi156.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-19T04:21:44.069 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-19T04:21:44.071 INFO:teuthology.orchestra.run.smithi156.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-19T04:21:44.074 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-19T04:21:44.087 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-19T04:21:44.091 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-19T04:21:44.092 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-19T04:21:44.100 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-19T04:21:44.102 INFO:teuthology.orchestra.run.smithi156.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-19T04:21:44.103 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-19T04:21:44.105 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-19T04:21:44.107 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-19T04:21:44.125 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-19T04:21:44.148 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-19T04:21:44.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-19T04:21:44.153 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-19T04:21:44.153 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-19T04:21:44.153 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-19T04:21:44.155 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-19T04:21:44.155 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-19T04:21:44.155 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-19T04:21:44.164 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-19T04:21:44.181 INFO:teuthology.orchestra.run.smithi156.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-19T04:21:44.182 INFO:teuthology.orchestra.run.smithi156.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-19T04:21:44.184 INFO:teuthology.orchestra.run.smithi156.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-19T04:21:44.184 INFO:teuthology.orchestra.run.smithi156.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-19T04:21:44.186 INFO:teuthology.orchestra.run.smithi156.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-19T04:21:44.193 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-19T04:21:44.194 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-19T04:21:44.194 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-19T04:21:44.197 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-19T04:21:44.197 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-19T04:21:44.198 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-19T04:21:44.198 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-19T04:21:44.199 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-19T04:21:44.202 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-19T04:21:44.211 INFO:teuthology.orchestra.run.smithi156.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-19T04:21:44.213 INFO:teuthology.orchestra.run.smithi156.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-19T04:21:44.214 INFO:teuthology.orchestra.run.smithi156.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-19T04:21:44.235 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-19T04:21:44.242 INFO:teuthology.orchestra.run.smithi156.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-19T04:21:44.242 INFO:teuthology.orchestra.run.smithi156.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-19T04:21:44.242 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-19T04:21:44.245 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-19T04:21:44.246 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-19T04:21:44.247 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-19T04:21:44.258 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-19T04:21:44.259 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-19T04:21:44.260 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-19T04:21:44.261 INFO:teuthology.orchestra.run.smithi156.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-19T04:21:44.261 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-19T04:21:44.261 INFO:teuthology.orchestra.run.smithi156.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-19T04:21:44.262 INFO:teuthology.orchestra.run.smithi156.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-19T04:21:44.262 INFO:teuthology.orchestra.run.smithi156.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-19T04:21:44.263 INFO:teuthology.orchestra.run.smithi156.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-19T04:21:44.263 INFO:teuthology.orchestra.run.smithi156.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-19T04:21:44.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-19T04:21:44.267 INFO:teuthology.orchestra.run.smithi156.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-19T04:21:44.268 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-19T04:21:44.270 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-19T04:21:44.281 INFO:teuthology.orchestra.run.smithi156.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-19T04:21:44.282 INFO:teuthology.orchestra.run.smithi156.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-19T04:21:44.283 INFO:teuthology.orchestra.run.smithi156.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-19T04:21:44.284 INFO:teuthology.orchestra.run.smithi156.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-19T04:21:44.290 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-19T04:21:44.291 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-19T04:21:44.296 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-19T04:21:44.297 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-19T04:21:44.299 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-19T04:21:44.303 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-19T04:21:44.319 INFO:teuthology.orchestra.run.smithi156.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-19T04:21:44.323 INFO:teuthology.orchestra.run.smithi156.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-19T04:21:44.324 INFO:teuthology.orchestra.run.smithi156.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-19T04:21:44.326 INFO:teuthology.orchestra.run.smithi156.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-19T04:21:44.326 INFO:teuthology.orchestra.run.smithi156.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-19T04:21:44.333 INFO:teuthology.orchestra.run.smithi156.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-19T04:21:44.334 INFO:teuthology.orchestra.run.smithi156.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-19T04:21:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-19T04:21:44.353 INFO:teuthology.orchestra.run.smithi156.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-19T04:21:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-19T04:21:44.374 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-19T04:21:44.375 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-19T04:21:44.376 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-19T04:21:44.376 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-19T04:21:44.377 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-19T04:21:44.380 INFO:teuthology.orchestra.run.smithi156.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-19T04:21:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-19T04:21:44.384 INFO:teuthology.orchestra.run.smithi156.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-19T04:21:44.394 INFO:teuthology.orchestra.run.smithi156.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-19T04:21:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-19T04:21:44.395 INFO:teuthology.orchestra.run.smithi156.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-19T04:21:44.398 INFO:teuthology.orchestra.run.smithi156.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-19T04:21:44.400 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-19T04:21:44.402 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-19T04:21:44.402 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-19T04:21:44.404 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-19T04:21:44.416 INFO:teuthology.orchestra.run.smithi156.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-19T04:21:44.428 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-19T04:21:44.428 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-19T04:21:44.442 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-19T04:21:44.442 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-19T04:21:44.443 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-19T04:21:44.443 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-19T04:21:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-19T04:21:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-19T04:21:44.445 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-19T04:21:44.448 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-19T04:21:44.462 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-19T04:21:44.462 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-19T04:21:44.463 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-19T04:21:44.464 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-19T04:21:44.464 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-19T04:21:44.472 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-19T04:21:44.475 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-19T04:21:44.481 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-19T04:21:44.485 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-19T04:21:44.485 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-19T04:21:44.486 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-19T04:21:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-19T04:21:44.492 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-19T04:21:44.492 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-19T04:21:44.498 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-19T04:21:44.501 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-19T04:21:44.501 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-19T04:21:44.502 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-19T04:21:44.505 INFO:teuthology.orchestra.run.smithi156.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-19T04:21:44.520 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-19T04:21:44.522 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-19T04:21:44.523 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-19T04:21:44.531 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-19T04:21:44.532 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-19T04:21:44.532 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-19T04:21:44.534 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-19T04:21:44.540 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-19T04:21:44.540 INFO:teuthology.orchestra.run.smithi156.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-19T04:21:44.577 INFO:teuthology.orchestra.run.smithi156.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-19T04:21:44.578 INFO:teuthology.orchestra.run.smithi156.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-19T04:21:44.589 INFO:teuthology.orchestra.run.smithi156.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-19T04:21:44.592 INFO:teuthology.orchestra.run.smithi156.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-19T04:21:44.617 INFO:teuthology.orchestra.run.smithi156.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-19T04:21:44.930 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-19T04:21:44.932 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-19T04:21:44.942 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-19T04:21:45.042 INFO:teuthology.orchestra.run.smithi156.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-19T04:21:45.050 INFO:teuthology.orchestra.run.smithi156.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-19T04:21:45.082 INFO:teuthology.orchestra.run.smithi156.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-19T04:21:46.420 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-19T04:21:46.668 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-19T04:21:46.682 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-19T04:21:46.690 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-19T04:21:46.761 INFO:teuthology.orchestra.run.smithi156.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-19T04:21:46.769 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-19T04:21:47.044 INFO:teuthology.orchestra.run.smithi156.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-19T04:21:47.058 INFO:teuthology.orchestra.run.smithi156.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-19T04:21:47.068 INFO:teuthology.orchestra.run.smithi156.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-19T04:21:47.165 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-19T04:21:47.172 INFO:teuthology.orchestra.run.smithi156.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-19T04:21:47.606 INFO:teuthology.orchestra.run.smithi156.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-19T04:21:48.673 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-19T04:21:48.673 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-19T04:21:48.691 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-19T04:21:48.856 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-19T04:21:48.877 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-19T04:21:48.880 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-19T04:21:48.961 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-19T04:21:49.262 INFO:teuthology.orchestra.run.smithi156.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-19T04:21:49.263 INFO:teuthology.orchestra.run.smithi156.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-19T04:21:49.279 INFO:teuthology.orchestra.run.smithi156.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-19T04:21:49.389 INFO:teuthology.orchestra.run.smithi156.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-19T04:21:49.443 INFO:teuthology.orchestra.run.smithi156.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-19T04:21:49.454 INFO:teuthology.orchestra.run.smithi156.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-19T04:21:49.478 INFO:teuthology.orchestra.run.smithi133.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-19T04:21:49.479 INFO:teuthology.orchestra.run.smithi133.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-19T04:21:49.588 INFO:teuthology.orchestra.run.smithi156.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-19T04:21:50.198 INFO:teuthology.orchestra.run.smithi156.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-19T04:21:50.199 INFO:teuthology.orchestra.run.smithi156.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-19T04:21:52.732 INFO:teuthology.orchestra.run.smithi133.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-19T04:21:52.735 INFO:teuthology.orchestra.run.smithi133.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-19T04:21:52.740 INFO:teuthology.orchestra.run.smithi133.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-19T04:21:52.741 INFO:teuthology.orchestra.run.smithi133.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-19T04:21:52.742 INFO:teuthology.orchestra.run.smithi133.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-19T04:21:52.743 INFO:teuthology.orchestra.run.smithi133.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-19T04:21:53.307 INFO:teuthology.orchestra.run.smithi133.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-19T04:21:53.310 INFO:teuthology.orchestra.run.smithi133.stdout:Get:125 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-766-g0edf41a6-1jammy [3,119 kB] 2024-01-19T04:21:53.504 INFO:teuthology.orchestra.run.smithi133.stdout:Get:126 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-766-g0edf41a6-1jammy [178 kB] 2024-01-19T04:21:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:Get:127 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-766-g0edf41a6-1jammy [702 MB] 2024-01-19T04:21:53.924 INFO:teuthology.orchestra.run.smithi156.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-19T04:21:53.926 INFO:teuthology.orchestra.run.smithi156.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-19T04:21:53.931 INFO:teuthology.orchestra.run.smithi156.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-19T04:21:53.933 INFO:teuthology.orchestra.run.smithi156.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-19T04:21:53.934 INFO:teuthology.orchestra.run.smithi156.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-19T04:21:53.935 INFO:teuthology.orchestra.run.smithi156.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-19T04:21:54.641 INFO:teuthology.orchestra.run.smithi156.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-19T04:21:54.643 INFO:teuthology.orchestra.run.smithi156.stdout:Get:125 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-766-g0edf41a6-1jammy [3,119 kB] 2024-01-19T04:21:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:Get:126 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-766-g0edf41a6-1jammy [178 kB] 2024-01-19T04:21:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:Get:127 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-766-g0edf41a6-1jammy [702 MB] 2024-01-19T04:22:40.148 INFO:teuthology.orchestra.run.smithi133.stdout:Get:128 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [18.1 MB] 2024-01-19T04:22:41.224 INFO:teuthology.orchestra.run.smithi133.stdout:Get:129 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-766-g0edf41a6-1jammy [77.6 MB] 2024-01-19T04:22:47.697 INFO:teuthology.orchestra.run.smithi133.stdout:Get:130 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-766-g0edf41a6-1jammy [41.3 MB] 2024-01-19T04:22:50.515 INFO:teuthology.orchestra.run.smithi133.stdout:Get:131 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-766-g0edf41a6-1jammy [158 MB] 2024-01-19T04:22:52.343 INFO:teuthology.orchestra.run.smithi156.stdout:Get:128 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [18.1 MB] 2024-01-19T04:22:53.332 INFO:teuthology.orchestra.run.smithi156.stdout:Get:129 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-766-g0edf41a6-1jammy [77.6 MB] 2024-01-19T04:22:59.212 INFO:teuthology.orchestra.run.smithi156.stdout:Get:130 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-766-g0edf41a6-1jammy [41.3 MB] 2024-01-19T04:23:03.408 INFO:teuthology.orchestra.run.smithi156.stdout:Get:131 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-766-g0edf41a6-1jammy [158 MB] 2024-01-19T04:23:04.694 INFO:teuthology.orchestra.run.smithi133.stdout:Get:132 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [535 MB] 2024-01-19T04:23:18.502 INFO:teuthology.orchestra.run.smithi156.stdout:Get:132 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [535 MB] 2024-01-19T04:23:40.080 INFO:teuthology.orchestra.run.smithi133.stdout:Get:133 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,155 MB] 2024-01-19T04:23:58.026 INFO:teuthology.orchestra.run.smithi156.stdout:Get:133 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,155 MB] 2024-01-19T04:24:58.534 INFO:teuthology.orchestra.run.smithi133.stdout:Get:134 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [16.3 MB] 2024-01-19T04:24:59.444 INFO:teuthology.orchestra.run.smithi133.stdout:Get:135 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [81.3 MB] 2024-01-19T04:25:04.359 INFO:teuthology.orchestra.run.smithi133.stdout:Get:136 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [11.2 MB] 2024-01-19T04:25:04.712 INFO:teuthology.orchestra.run.smithi133.stdout:Get:137 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [103 MB] 2024-01-19T04:25:10.128 INFO:teuthology.orchestra.run.smithi133.stdout:Get:138 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [164 MB] 2024-01-19T04:25:24.269 INFO:teuthology.orchestra.run.smithi133.stdout:Get:139 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-766-g0edf41a6-1jammy [319 MB] 2024-01-19T04:25:44.246 INFO:teuthology.orchestra.run.smithi156.stdout:Get:134 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [16.3 MB] 2024-01-19T04:25:46.532 INFO:teuthology.orchestra.run.smithi156.stdout:Get:135 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [81.3 MB] 2024-01-19T04:25:49.848 INFO:teuthology.orchestra.run.smithi133.stdout:Get:140 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,697 kB] 2024-01-19T04:25:49.880 INFO:teuthology.orchestra.run.smithi133.stdout:Get:141 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-766-g0edf41a6-1jammy [97.0 MB] 2024-01-19T04:25:53.769 INFO:teuthology.orchestra.run.smithi156.stdout:Get:136 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [11.2 MB] 2024-01-19T04:25:54.273 INFO:teuthology.orchestra.run.smithi156.stdout:Get:137 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [103 MB] 2024-01-19T04:25:56.661 INFO:teuthology.orchestra.run.smithi133.stdout:Get:142 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [2,998 kB] 2024-01-19T04:25:57.333 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 3,660 MB in 4min 13s (14.5 MB/s) 2024-01-19T04:25:57.468 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-19T04:25:57.566 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2024-01-19T04:25:57.572 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-19T04:25:57.616 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-19T04:25:57.869 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-19T04:25:57.896 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-19T04:25:57.927 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:25:58.247 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cmd2. 2024-01-19T04:25:58.273 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-19T04:25:58.313 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-19T04:25:58.691 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-19T04:25:58.717 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-19T04:25:58.825 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:25:59.129 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-19T04:25:59.155 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-19T04:25:59.186 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:25:59.264 INFO:teuthology.orchestra.run.smithi156.stdout:Get:138 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [164 MB] 2024-01-19T04:25:59.489 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-19T04:25:59.516 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-19T04:25:59.556 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:26:00.001 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-19T04:26:00.027 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:26:00.083 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:26:00.462 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-19T04:26:00.489 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:26:00.520 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:26:00.849 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-19T04:26:00.875 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:26:00.915 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:26:01.268 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-19T04:26:01.295 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-19T04:26:01.335 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:26:01.663 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librados2. 2024-01-19T04:26:01.689 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:01.729 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:02.106 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librbd1. 2024-01-19T04:26:02.121 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:02.156 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:02.576 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2024-01-19T04:26:02.602 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:02.651 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:02.920 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2024-01-19T04:26:02.935 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:02.970 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:03.273 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-19T04:26:03.299 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:03.339 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:03.592 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2024-01-19T04:26:03.618 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:03.658 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:03.955 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-19T04:26:03.981 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:04.021 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:04.308 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2024-01-19T04:26:04.334 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-19T04:26:04.374 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-19T04:26:04.643 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2024-01-19T04:26:04.658 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:04.702 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:05.055 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-19T04:26:05.081 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-19T04:26:05.121 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:26:05.399 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-19T04:26:05.414 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-19T04:26:05.448 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:26:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-19T04:26:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-19T04:26:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:26:06.096 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua5.1. 2024-01-19T04:26:06.110 INFO:teuthology.orchestra.run.smithi156.stdout:Get:139 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-766-g0edf41a6-1jammy [319 MB] 2024-01-19T04:26:06.122 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-19T04:26:06.163 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:26:06.483 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-any. 2024-01-19T04:26:06.509 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-19T04:26:06.566 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-19T04:26:06.810 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package zip. 2024-01-19T04:26:06.836 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-19T04:26:06.868 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking zip (3.0-12build2) ... 2024-01-19T04:26:07.155 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package unzip. 2024-01-19T04:26:07.181 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-19T04:26:07.221 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:26:07.608 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package luarocks. 2024-01-19T04:26:07.634 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-19T04:26:07.675 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:26:08.040 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2024-01-19T04:26:08.067 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:08.107 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:08.626 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2024-01-19T04:26:08.652 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:08.693 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:09.046 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-19T04:26:09.072 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-19T04:26:09.112 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:26:09.398 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2024-01-19T04:26:09.424 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:09.465 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:09.860 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2024-01-19T04:26:09.886 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:09.927 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:11.223 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2024-01-19T04:26:11.249 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:11.299 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:11.844 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-19T04:26:11.870 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-19T04:26:11.910 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:26:12.188 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cheroot. 2024-01-19T04:26:12.215 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-19T04:26:12.255 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:26:12.574 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-19T04:26:12.601 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-19T04:26:12.641 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:26:12.943 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-19T04:26:12.970 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-19T04:26:13.010 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:26:13.296 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-19T04:26:13.323 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-19T04:26:13.371 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:26:13.641 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempora. 2024-01-19T04:26:13.667 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-19T04:26:13.699 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-19T04:26:13.993 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-portend. 2024-01-19T04:26:14.019 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-19T04:26:14.051 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-19T04:26:14.321 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-19T04:26:14.347 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-19T04:26:14.387 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-19T04:26:14.690 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-19T04:26:14.717 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-19T04:26:14.757 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:26:15.152 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2024-01-19T04:26:15.178 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-19T04:26:15.218 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-19T04:26:15.538 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2024-01-19T04:26:15.564 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-19T04:26:15.605 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-19T04:26:15.866 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-19T04:26:15.892 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-19T04:26:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:26:16.227 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2024-01-19T04:26:16.253 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-19T04:26:16.293 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:26:16.630 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-19T04:26:16.656 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-19T04:26:16.696 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:26:16.991 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-19T04:26:17.017 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-19T04:26:17.057 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:26:17.293 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2024-01-19T04:26:17.308 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-19T04:26:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:26:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2024-01-19T04:26:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-19T04:26:17.749 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:26:18.041 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2024-01-19T04:26:18.067 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-19T04:26:18.107 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:26:18.393 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2024-01-19T04:26:18.420 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-19T04:26:18.460 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:26:18.779 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-19T04:26:18.795 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-19T04:26:18.838 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:26:19.157 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-19T04:26:19.184 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-19T04:26:19.224 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:26:19.527 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2024-01-19T04:26:19.553 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-19T04:26:19.593 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-19T04:26:19.888 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2024-01-19T04:26:19.914 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-19T04:26:19.946 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:26:20.292 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-certifi. 2024-01-19T04:26:20.319 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-19T04:26:20.359 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-19T04:26:20.686 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-idna. 2024-01-19T04:26:20.713 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-19T04:26:20.758 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-19T04:26:21.306 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-urllib3. 2024-01-19T04:26:21.332 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-19T04:26:21.372 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:26:21.692 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests. 2024-01-19T04:26:21.719 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-19T04:26:21.759 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:26:22.053 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-19T04:26:22.080 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-19T04:26:22.119 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:26:22.431 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-19T04:26:22.458 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:22.497 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:22.852 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-19T04:26:22.878 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:22.918 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:23.288 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-19T04:26:23.315 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-19T04:26:23.355 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:26:23.641 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2024-01-19T04:26:23.667 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-19T04:26:23.707 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-19T04:26:24.118 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2024-01-19T04:26:24.145 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:24.185 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:24.588 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2024-01-19T04:26:24.615 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:24.655 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:25.258 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2024-01-19T04:26:25.285 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:25.324 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:26.428 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2024-01-19T04:26:26.454 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:26.502 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:26.830 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2024-01-19T04:26:26.856 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2024-01-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2024-01-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-19T04:26:28.305 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-19T04:26:28.333 INFO:teuthology.orchestra.run.smithi156.stdout:Get:140 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,697 kB] 2024-01-19T04:26:28.365 INFO:teuthology.orchestra.run.smithi156.stdout:Get:141 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-766-g0edf41a6-1jammy [97.0 MB] 2024-01-19T04:26:28.666 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-19T04:26:28.693 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:26:28.741 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:26:29.796 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-babel. 2024-01-19T04:26:29.823 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:26:29.870 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:26:30.199 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2024-01-19T04:26:30.226 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-19T04:26:30.265 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-19T04:26:30.601 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-19T04:26:30.629 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:30.668 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:31.013 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-19T04:26:31.040 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-19T04:26:31.079 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-19T04:26:31.399 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2024-01-19T04:26:31.425 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-19T04:26:31.465 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:26:31.810 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-19T04:26:31.837 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:31.876 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:32.123 INFO:teuthology.orchestra.run.smithi156.stdout:Get:142 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [2,998 kB] 2024-01-19T04:26:32.279 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-19T04:26:32.303 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-19T04:26:32.338 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:26:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 3,660 MB in 4min 49s (12.7 MB/s) 2024-01-19T04:26:32.841 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2024-01-19T04:26:32.872 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-19T04:26:32.924 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:26:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-19T04:26:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2024-01-19T04:26:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-19T04:26:33.080 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-19T04:26:33.269 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-19T04:26:33.296 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-19T04:26:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-19T04:26:33.376 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-19T04:26:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:26:33.421 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:26:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cmd2. 2024-01-19T04:26:33.716 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-19T04:26:33.732 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2024-01-19T04:26:33.751 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-19T04:26:33.760 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-19T04:26:33.799 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:26:34.054 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-19T04:26:34.080 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-19T04:26:34.146 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:26:34.482 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-19T04:26:34.491 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-19T04:26:34.498 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-19T04:26:34.518 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:34.540 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:26:34.557 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:34.877 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-19T04:26:34.903 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-19T04:26:34.943 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:26:35.364 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-19T04:26:35.390 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:26:35.430 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:26:35.519 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2024-01-19T04:26:35.546 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-19T04:26:35.585 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-19T04:26:35.817 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-19T04:26:35.843 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:26:35.871 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-19T04:26:35.883 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:26:35.898 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-19T04:26:35.938 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:26:36.236 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-19T04:26:36.249 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-19T04:26:36.263 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:26:36.265 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-19T04:26:36.299 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:26:36.303 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:26:36.535 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2024-01-19T04:26:36.551 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-19T04:26:36.585 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-19T04:26:36.639 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-19T04:26:36.666 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-19T04:26:36.697 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:26:36.914 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2024-01-19T04:26:36.942 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-19T04:26:36.980 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-19T04:26:36.992 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librados2. 2024-01-19T04:26:37.018 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:37.058 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:37.300 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-19T04:26:37.327 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-19T04:26:37.367 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:26:37.503 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librbd1. 2024-01-19T04:26:37.529 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:37.569 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:37.678 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2024-01-19T04:26:37.705 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-19T04:26:37.744 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-19T04:26:37.972 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs2. 2024-01-19T04:26:37.988 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:38.022 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:38.031 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-19T04:26:38.047 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-19T04:26:38.089 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:26:38.300 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rados. 2024-01-19T04:26:38.326 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:38.366 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:38.719 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-19T04:26:38.736 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-19T04:26:38.746 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:38.752 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:38.785 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:38.794 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:39.038 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cephfs. 2024-01-19T04:26:39.053 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:39.064 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-19T04:26:39.091 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-19T04:26:39.096 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:39.122 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:26:39.366 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-19T04:26:39.392 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:39.424 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:39.492 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-19T04:26:39.519 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:26:39.558 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:26:39.719 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-prettytable. 2024-01-19T04:26:39.746 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2024-01-19T04:26:39.826 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:26:39.868 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-19T04:26:40.038 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rbd. 2024-01-19T04:26:40.053 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:40.096 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:40.115 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2024-01-19T04:26:40.143 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-19T04:26:40.173 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:26:40.432 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-19T04:26:40.459 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-19T04:26:40.485 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2024-01-19T04:26:40.498 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:26:40.512 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-19T04:26:40.551 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:26:40.760 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-19T04:26:40.786 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-19T04:26:40.843 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:26:40.872 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2024-01-19T04:26:40.888 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:40.930 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:41.121 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-19T04:26:41.136 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-19T04:26:41.179 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:26:41.507 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package lua5.1. 2024-01-19T04:26:41.534 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-19T04:26:41.574 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:26:41.885 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package lua-any. 2024-01-19T04:26:41.912 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-19T04:26:41.952 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-19T04:26:42.154 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package zip. 2024-01-19T04:26:42.170 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-19T04:26:42.212 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking zip (3.0-12build2) ... 2024-01-19T04:26:42.732 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package unzip. 2024-01-19T04:26:42.759 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-19T04:26:42.799 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:26:42.976 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2024-01-19T04:26:43.003 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:43.195 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package luarocks. 2024-01-19T04:26:43.221 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-19T04:26:43.261 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:26:43.363 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-19T04:26:43.390 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:43.421 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:43.602 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librgw2. 2024-01-19T04:26:43.629 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:43.660 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:43.774 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-colorama. 2024-01-19T04:26:43.802 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-19T04:26:43.841 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-19T04:26:44.085 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-shell. 2024-01-19T04:26:44.112 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:44.151 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:44.179 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rgw. 2024-01-19T04:26:44.195 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:44.237 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:44.412 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-top. 2024-01-19T04:26:44.428 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:44.470 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:44.574 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-19T04:26:44.600 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-19T04:26:44.640 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:26:44.706 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-19T04:26:44.722 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:44.918 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libradosstriper1. 2024-01-19T04:26:44.945 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:44.984 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:45.067 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-19T04:26:45.095 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-19T04:26:45.142 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:26:45.363 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-common. 2024-01-19T04:26:45.390 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:45.429 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:45.463 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-19T04:26:45.490 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-19T04:26:45.530 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:26:45.892 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2024-01-19T04:26:45.919 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-19T04:26:45.958 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:26:46.339 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pkg-config. 2024-01-19T04:26:46.366 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-19T04:26:46.397 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:26:46.625 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-19T04:26:46.651 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-base. 2024-01-19T04:26:46.652 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-19T04:26:46.678 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:46.691 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:26:46.727 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:47.128 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-19T04:26:47.155 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-19T04:26:47.194 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-19T04:26:47.297 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-19T04:26:47.324 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-19T04:26:47.363 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:26:47.455 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2024-01-19T04:26:47.482 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-19T04:26:47.522 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-19T04:26:47.666 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cheroot. 2024-01-19T04:26:47.693 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-19T04:26:47.733 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:26:47.867 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2024-01-19T04:26:47.894 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-19T04:26:47.933 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:26:48.021 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-19T04:26:48.048 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-19T04:26:48.088 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2024-01-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-19T04:26:48.311 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-19T04:26:48.408 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-19T04:26:48.434 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-19T04:26:48.474 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:26:48.639 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2024-01-19T04:26:48.666 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-19T04:26:48.705 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-19T04:26:48.760 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-19T04:26:48.787 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-19T04:26:48.826 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:26:49.034 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pygments. 2024-01-19T04:26:49.062 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-19T04:26:49.096 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-tempora. 2024-01-19T04:26:49.100 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:26:49.123 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-19T04:26:49.171 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-19T04:26:49.508 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-portend. 2024-01-19T04:26:49.529 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-19T04:26:49.535 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-19T04:26:49.546 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-19T04:26:49.574 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-19T04:26:49.579 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:26:49.860 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-19T04:26:49.874 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-toml. 2024-01-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-19T04:26:49.902 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-19T04:26:49.927 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-19T04:26:49.940 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-19T04:26:50.197 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-19T04:26:50.224 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-19T04:26:50.260 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2024-01-19T04:26:50.263 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:26:50.287 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-19T04:26:50.326 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:26:50.617 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-natsort. 2024-01-19T04:26:50.638 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2024-01-19T04:26:50.644 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-19T04:26:50.666 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-19T04:26:50.683 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-19T04:26:50.704 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:26:50.966 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-19T04:26:50.993 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-19T04:26:50.994 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-logutils. 2024-01-19T04:26:51.021 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-19T04:26:51.032 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:26:51.061 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-19T04:26:51.331 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-19T04:26:51.358 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-19T04:26:51.397 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:26:51.700 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-mako. 2024-01-19T04:26:51.727 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-19T04:26:51.767 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:26:51.996 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2024-01-19T04:26:52.024 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:52.095 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-19T04:26:52.102 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:52.122 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-19T04:26:52.162 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:26:52.473 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-19T04:26:52.500 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-19T04:26:52.539 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:26:52.801 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webob. 2024-01-19T04:26:52.827 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-19T04:26:52.867 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:26:52.914 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2024-01-19T04:26:52.942 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:52.980 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:53.212 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-waitress. 2024-01-19T04:26:53.239 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-19T04:26:53.282 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:26:53.325 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-mirror. 2024-01-19T04:26:53.352 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:53.391 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:53.598 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-tempita. 2024-01-19T04:26:53.625 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-19T04:26:53.665 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:26:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-nbd. 2024-01-19T04:26:53.830 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:53.968 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-paste. 2024-01-19T04:26:53.995 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-19T04:26:54.034 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:26:54.105 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-19T04:26:54.121 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:54.163 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:54.363 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-19T04:26:54.389 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-19T04:26:54.437 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:26:54.732 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-19T04:26:54.758 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-19T04:26:54.798 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:26:55.102 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webtest. 2024-01-19T04:26:55.128 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-19T04:26:55.168 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-19T04:26:55.421 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pecan. 2024-01-19T04:26:55.436 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-19T04:26:55.479 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:26:55.809 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-certifi. 2024-01-19T04:26:55.836 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-19T04:26:55.875 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-19T04:26:56.195 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-idna. 2024-01-19T04:26:56.222 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-19T04:26:56.261 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-19T04:26:56.556 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-urllib3. 2024-01-19T04:26:56.583 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-19T04:26:56.631 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:26:56.959 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-requests. 2024-01-19T04:26:56.986 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-19T04:26:57.026 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:26:57.362 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-19T04:26:57.389 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-19T04:26:57.428 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:26:57.732 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-19T04:26:57.747 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:26:57.790 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:58.170 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-19T04:26:58.196 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:58.236 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:58.540 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-19T04:26:58.566 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-19T04:26:58.606 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:26:58.925 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-openssl. 2024-01-19T04:26:58.952 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-19T04:26:58.992 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-19T04:26:59.270 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr. 2024-01-19T04:26:59.296 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:59.336 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:26:59.707 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mon. 2024-01-19T04:26:59.733 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:26:59.773 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:00.393 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-osd. 2024-01-19T04:27:00.420 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:00.459 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:01.125 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-19T04:27:01.141 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:01.183 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:01.462 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph. 2024-01-19T04:27:01.478 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:01.512 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:01.652 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-19T04:27:01.668 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:01.710 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:01.790 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-fuse. 2024-01-19T04:27:01.817 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:01.856 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:02.201 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mds. 2024-01-19T04:27:02.228 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:02.268 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:02.662 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephadm. 2024-01-19T04:27:02.689 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:02.695 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-19T04:27:02.711 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:02.729 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:02.745 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:02.982 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-19T04:27:03.009 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-19T04:27:03.040 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-19T04:27:03.351 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-19T04:27:03.366 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:27:03.407 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-19T04:27:03.409 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:27:03.434 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:03.473 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:04.423 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-babel. 2024-01-19T04:27:04.450 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:27:04.489 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:27:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jinja2. 2024-01-19T04:27:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-19T04:27:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-19T04:27:05.228 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-19T04:27:05.241 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-19T04:27:05.256 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:05.258 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:05.295 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:05.640 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-19T04:27:05.667 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-19T04:27:05.706 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-19T04:27:06.018 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-routes. 2024-01-19T04:27:06.045 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-19T04:27:06.101 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:27:06.437 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-19T04:27:06.464 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:06.504 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:06.924 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-19T04:27:06.940 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-19T04:27:06.982 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:27:07.527 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-joblib. 2024-01-19T04:27:07.554 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-19T04:27:07.594 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:27:07.939 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-19T04:27:07.966 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-19T04:27:08.091 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:27:08.394 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn. 2024-01-19T04:27:08.421 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-19T04:27:08.460 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:27:09.178 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-19T04:27:09.206 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:09.244 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:10.206 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cachetools. 2024-01-19T04:27:10.234 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-19T04:27:10.273 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-19T04:27:10.495 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-19T04:27:10.521 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:10.560 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:10.576 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-19T04:27:10.603 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-19T04:27:10.642 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:27:10.996 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-19T04:27:11.023 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-19T04:27:11.062 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:27:11.357 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rsa. 2024-01-19T04:27:11.384 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-19T04:27:11.423 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-19T04:27:11.744 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-google-auth. 2024-01-19T04:27:11.771 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-19T04:27:11.810 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-19T04:27:12.130 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-19T04:27:12.157 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-19T04:27:12.205 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:27:12.492 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-websocket. 2024-01-19T04:27:12.519 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-19T04:27:12.558 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-19T04:27:12.862 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-19T04:27:12.889 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-19T04:27:12.928 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:27:13.892 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-19T04:27:13.919 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:13.958 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:14.286 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-19T04:27:14.313 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-19T04:27:14.353 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:27:14.715 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-19T04:27:14.742 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:27:14.781 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:27:15.034 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package jq. 2024-01-19T04:27:15.061 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:27:15.125 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-19T04:27:15.378 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package socat. 2024-01-19T04:27:15.405 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-19T04:27:15.444 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:27:15.756 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package xmlstarlet. 2024-01-19T04:27:15.772 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-19T04:27:15.814 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:27:16.177 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-test. 2024-01-19T04:27:16.204 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:16.243 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:18.415 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-volume. 2024-01-19T04:27:18.442 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:18.481 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:18.835 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-19T04:27:18.862 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:18.901 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:19.196 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-colorama. 2024-01-19T04:27:19.223 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-19T04:27:19.262 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-19T04:27:19.498 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-shell. 2024-01-19T04:27:19.514 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:19.548 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:19.784 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-top. 2024-01-19T04:27:19.811 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:27:19.850 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:20.086 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-19T04:27:20.114 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:20.169 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:20.489 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-19T04:27:20.516 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-19T04:27:20.564 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:27:20.894 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-19T04:27:20.923 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-19T04:27:20.960 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:27:21.134 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-19T04:27:21.150 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:21.192 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:21.289 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package nvme-cli. 2024-01-19T04:27:21.316 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-19T04:27:21.364 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:27:21.586 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librados2-dbg. 2024-01-19T04:27:21.602 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:21.644 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:21.786 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package pkg-config. 2024-01-19T04:27:21.813 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-19T04:27:21.852 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:27:22.113 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-19T04:27:22.129 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-19T04:27:22.171 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:27:22.592 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-19T04:27:22.619 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-19T04:27:22.658 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-19T04:27:22.672 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-19T04:27:22.700 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:22.856 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:22.961 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastescript. 2024-01-19T04:27:22.988 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-19T04:27:23.027 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-19T04:27:23.274 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-19T04:27:23.290 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:23.332 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:23.372 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pluggy. 2024-01-19T04:27:23.400 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-19T04:27:23.438 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:27:23.759 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-psutil. 2024-01-19T04:27:23.786 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-19T04:27:23.825 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-19T04:27:24.161 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-py. 2024-01-19T04:27:24.189 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-19T04:27:24.228 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-19T04:27:24.523 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pygments. 2024-01-19T04:27:24.550 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-19T04:27:24.585 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-19T04:27:24.591 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:27:24.601 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:24.635 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:25.054 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-19T04:27:25.081 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-19T04:27:25.120 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:27:25.448 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-toml. 2024-01-19T04:27:25.476 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-19T04:27:25.514 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-19T04:27:25.792 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pytest. 2024-01-19T04:27:25.820 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-19T04:27:25.859 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:27:26.196 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplejson. 2024-01-19T04:27:26.223 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-19T04:27:26.262 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:27:26.313 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-19T04:27:26.340 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:26.379 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:26.540 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-19T04:27:26.567 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-19T04:27:26.606 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:27:27.294 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package radosgw. 2024-01-19T04:27:27.322 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:27.360 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:28.096 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-fuse. 2024-01-19T04:27:28.112 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:28.154 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:28.457 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-mirror. 2024-01-19T04:27:28.485 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:28.524 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:28.969 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-nbd. 2024-01-19T04:27:28.996 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:29.035 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:29.296 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-19T04:27:29.312 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:29.354 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:29.548 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-19T04:27:29.576 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:29.614 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:29.900 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-19T04:27:29.916 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:29.958 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:31.119 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-19T04:27:31.135 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:31.168 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:31.516 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-19T04:27:31.774 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:27:31.875 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:27:32.109 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-19T04:27:32.422 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-19T04:27:32.843 INFO:teuthology.orchestra.run.smithi133.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-19T04:27:33.086 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:33.612 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2024-01-19T04:27:33.734 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:27:33.994 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:27:34.254 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:27:34.363 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:27:34.614 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-19T04:27:34.873 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:27:34.999 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-19T04:27:35.301 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:27:35.653 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-19T04:27:35.887 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-19T04:27:36.155 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-19T04:27:36.431 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:27:36.516 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-19T04:27:36.544 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:36.583 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:36.691 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:27:36.934 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:27:37.043 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-19T04:27:37.059 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:37.101 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:37.210 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:27:37.461 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:37.704 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:27:37.830 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:27:37.972 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-19T04:27:38.095 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-19T04:27:38.112 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:38.154 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:38.240 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:27:38.349 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:27:38.592 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:27:38.806 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-19T04:27:38.822 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:38.856 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:38.990 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-19T04:27:39.032 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-19T04:27:39.079 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:27:39.180 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-19T04:27:39.539 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:27:39.665 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-19T04:27:39.908 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:27:40.159 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:27:40.461 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up zip (3.0-12build2) ... 2024-01-19T04:27:40.561 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:27:40.575 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-19T04:27:40.591 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:40.633 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:41.213 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:27:41.473 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:27:41.599 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:27:41.725 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:27:42.009 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-19T04:27:42.410 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-19T04:27:42.670 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:27:43.038 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:27:43.322 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-19T04:27:43.632 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:27:43.975 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:27:44.209 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:27:44.335 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:44.628 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-idna (3.3-1) ... 2024-01-19T04:27:44.946 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:27:45.886 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-19T04:27:45.914 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:45.952 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:46.152 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:27:46.378 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:27:46.513 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-19T04:27:46.780 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:27:46.906 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:27:47.015 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:27:47.300 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:27:47.560 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-19T04:27:47.819 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:27:47.945 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:27:48.255 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:27:48.514 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-19T04:27:48.782 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-19T04:27:49.033 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:27:49.300 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-19T04:27:49.585 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:27:49.711 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-19T04:27:50.004 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:27:50.121 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:27:50.431 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:27:50.732 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:27:50.983 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:27:51.092 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:27:51.219 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:27:51.308 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-19T04:27:51.537 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:27:51.638 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:27:52.047 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:27:52.315 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-19T04:27:52.441 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-19T04:27:52.692 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:27:52.827 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-19T04:27:53.144 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:27:53.478 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:27:54.090 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-19T04:27:54.300 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-19T04:27:54.551 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-19T04:27:54.819 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:27:55.079 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:27:55.439 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-19T04:27:55.723 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:27:56.045 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:27:56.171 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:56.297 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:56.406 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:27:56.742 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:56.868 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:56.894 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-19T04:27:56.910 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:56.952 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:56.994 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-19T04:27:57.296 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:57.396 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librados2-dbg. 2024-01-19T04:27:57.412 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:57.421 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:57.455 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:57.548 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:57.657 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:57.758 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:57.955 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:27:57.956 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:27:58.434 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:58.533 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-19T04:27:58.559 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:58.560 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:58.599 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:58.685 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:58.812 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:58.938 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:58.993 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-19T04:27:59.009 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:27:59.051 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:59.063 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:27:59.190 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:28:00.354 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-19T04:28:00.370 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:28:00.384 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:00.412 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:00.510 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:00.645 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:00.771 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:00.897 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:01.023 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:01.132 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:01.233 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:01.350 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:01.510 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:01.636 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:02.171 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2024-01-19T04:28:02.182 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-19T04:28:02.210 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:28:02.248 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:02.522 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2024-01-19T04:28:02.699 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2024-01-19T04:28:02.710 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-19T04:28:02.853 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-19T04:28:03.177 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-19T04:28:03.628 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:03.838 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:28:03.838 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:28:04.307 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:04.447 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:04.900 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:28:04.900 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:28:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:05.476 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-19T04:28:05.492 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:28:05.534 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-19T04:28:05.820 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-19T04:28:05.848 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:28:05.886 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:06.142 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:06.368 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:28:06.368 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:28:06.836 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:06.962 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:07.173 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-19T04:28:07.174 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-19T04:28:07.272 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-19T04:28:07.289 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:28:07.322 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:07.596 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:07.661 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-19T04:28:07.806 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:28:07.806 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:28:07.911 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:28:08.037 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:28:08.264 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:08.296 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-19T04:28:08.365 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:08.483 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:08.608 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-19T04:28:08.609 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:08.874 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:28:08.874 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:28:09.020 INFO:teuthology.orchestra.run.smithi156.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-19T04:28:09.089 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:09.402 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:09.528 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:09.599 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user cephadm....done 2024-01-19T04:28:09.679 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:09.737 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:28:09.805 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:09.914 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:10.022 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:28:10.040 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:10.235 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:28:10.236 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:28:10.290 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:28:10.416 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:28:10.675 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-19T04:28:10.700 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:10.851 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:10.926 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:28:10.977 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:11.052 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-19T04:28:11.128 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:11.254 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:11.363 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:28:11.607 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-19T04:28:11.723 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-19T04:28:11.783 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:28:11.935 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:28:11.982 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-19T04:28:12.233 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-19T04:28:12.502 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:28:12.795 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:28:13.019 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:28:13.062 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:28:13.322 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:28:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:28:13.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-19T04:28:13.698 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:13.703 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2024-01-19T04:28:13.894 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2024-01-19T04:28:13.894 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2024-01-19T04:28:13.949 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:28:14.055 INFO:teuthology.orchestra.run.smithi133.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-19T04:28:14.055 INFO:teuthology.orchestra.run.smithi133.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-19T04:28:14.055 INFO:teuthology.orchestra.run.smithi133.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:28:14.056 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:28:14.057 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:28:14.057 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:28:14.057 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2024-01-19T04:28:14.057 INFO:teuthology.orchestra.run.smithi133.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-19T04:28:14.057 INFO:teuthology.orchestra.run.smithi133.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-19T04:28:14.057 INFO:teuthology.orchestra.run.smithi133.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-19T04:28:14.058 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-19T04:28:14.058 INFO:teuthology.orchestra.run.smithi133.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:28:14.058 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2024-01-19T04:28:14.058 INFO:teuthology.orchestra.run.smithi133.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-19T04:28:14.058 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-19T04:28:14.058 INFO:teuthology.orchestra.run.smithi133.stdout: libengine-pkcs11-openssl 2024-01-19T04:28:14.075 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:28:14.095 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2024-01-19T04:28:14.096 INFO:teuthology.orchestra.run.smithi133.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-19T04:28:14.096 INFO:teuthology.orchestra.run.smithi133.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-19T04:28:14.096 INFO:teuthology.orchestra.run.smithi133.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-19T04:28:14.097 INFO:teuthology.orchestra.run.smithi133.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-19T04:28:14.097 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-19T04:28:14.097 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-19T04:28:14.097 INFO:teuthology.orchestra.run.smithi133.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:28:14.098 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2024-01-19T04:28:14.098 INFO:teuthology.orchestra.run.smithi133.stdout: libssl3 2024-01-19T04:28:14.153 INFO:teuthology.orchestra.run.smithi133.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2024-01-19T04:28:14.153 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 54.6 MB of archives. 2024-01-19T04:28:14.153 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-19T04:28:14.153 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-19T04:28:14.201 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-19T04:28:14.267 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-19T04:28:14.334 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-19T04:28:14.349 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-19T04:28:14.350 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-19T04:28:14.353 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-19T04:28:14.354 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-19T04:28:14.355 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-19T04:28:14.356 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-19T04:28:14.358 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-19T04:28:14.358 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-19T04:28:14.359 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-19T04:28:14.379 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-19T04:28:14.469 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:28:14.595 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:28:14.682 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-19T04:28:14.684 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-19T04:28:14.684 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-19T04:28:14.687 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-19T04:28:14.687 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-19T04:28:14.713 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-19T04:28:14.714 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-19T04:28:14.722 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-19T04:28:14.722 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-19T04:28:14.747 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-19T04:28:14.747 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-19T04:28:14.758 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-19T04:28:14.778 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-19T04:28:14.781 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-19T04:28:14.781 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-19T04:28:14.782 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-19T04:28:14.782 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-19T04:28:14.792 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-19T04:28:14.793 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-19T04:28:14.854 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:28:15.003 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-19T04:28:15.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-19T04:28:15.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-19T04:28:15.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-19T04:28:15.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-19T04:28:15.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-19T04:28:15.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-19T04:28:15.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-19T04:28:15.365 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-19T04:28:15.394 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-19T04:28:15.419 INFO:teuthology.orchestra.run.smithi133.stdout:Preconfiguring packages ... 2024-01-19T04:28:15.483 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:28:15.560 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 54.6 MB in 1s (59.9 MB/s) 2024-01-19T04:28:15.609 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-19T04:28:15.692 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package flex. 2024-01-19T04:28:15.790 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173925 files and directories currently installed.) 2024-01-19T04:28:15.796 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-19T04:28:15.832 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-19T04:28:15.968 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:28:16.094 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-19T04:28:16.379 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:28:16.407 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:28:16.580 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-19T04:28:16.638 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:28:16.964 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up zip (3.0-12build2) ... 2024-01-19T04:28:17.090 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:28:17.183 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:28:17.657 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package bison. 2024-01-19T04:28:17.759 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173998 files and directories currently installed.) 2024-01-19T04:28:17.765 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-19T04:28:17.767 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:28:17.800 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:28:18.027 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:28:18.152 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-19T04:28:18.153 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:28:18.179 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-19T04:28:18.210 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:28:18.279 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:28:18.563 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package dump. 2024-01-19T04:28:18.580 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-19T04:28:18.590 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-19T04:28:18.629 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking dump (0.4b47-3) ... 2024-01-19T04:28:18.916 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package indent. 2024-01-19T04:28:18.932 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:28:18.974 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:28:18.981 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-19T04:28:19.218 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-19T04:28:19.234 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-19T04:28:19.249 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:28:19.276 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:28:19.580 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-19T04:28:19.608 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-19T04:28:19.634 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:28:19.646 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:28:19.907 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-19T04:28:19.918 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-19T04:28:19.923 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-19T04:28:19.965 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:28:20.220 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:28:20.310 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-19T04:28:20.338 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-19T04:28:20.377 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:28:20.580 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:28:20.604 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-19T04:28:20.620 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-19T04:28:20.654 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:28:20.831 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:28:20.890 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjson-perl. 2024-01-19T04:28:20.918 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-19T04:28:20.957 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-19T04:28:20.957 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:21.258 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-idna (3.3-1) ... 2024-01-19T04:28:21.268 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-19T04:28:21.295 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-19T04:28:21.334 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:28:21.592 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:28:22.790 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:28:22.812 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-19T04:28:22.840 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:28:22.879 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:28:23.025 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:28:23.123 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-19T04:28:23.139 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:28:23.160 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-19T04:28:23.173 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:28:23.427 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:28:23.484 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-19T04:28:23.512 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:28:23.550 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:28:23.562 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:28:23.688 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:28:23.903 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-19T04:28:23.931 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-19T04:28:23.964 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:28:23.969 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:28:24.215 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-19T04:28:24.297 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-19T04:28:24.325 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:28:24.364 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:28:24.466 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:28:24.592 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:28:24.641 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-19T04:28:24.657 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:28:24.699 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:28:24.902 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:28:25.187 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-19T04:28:25.427 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-19T04:28:25.455 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:28:25.463 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-19T04:28:25.494 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:28:25.714 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:28:25.796 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-19T04:28:25.824 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:28:25.863 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:28:25.965 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-19T04:28:26.131 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-19T04:28:26.148 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:28:26.190 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:28:26.225 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:28:26.351 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-19T04:28:26.627 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-19T04:28:26.635 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:28:26.654 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-19T04:28:26.693 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:28:26.770 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:28:27.038 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package modemmanager. 2024-01-19T04:28:27.063 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:28:27.065 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:28:27.104 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:28:27.347 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:28:27.598 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:28:27.677 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager. 2024-01-19T04:28:27.704 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:28:27.724 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:28:27.743 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:28:27.850 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:28:27.939 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-19T04:28:28.185 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:28:28.300 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ppp. 2024-01-19T04:28:28.311 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:28:28.328 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-19T04:28:28.585 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:28:28.714 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:28:28.855 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pptp-linux. 2024-01-19T04:28:28.875 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-19T04:28:28.973 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-19T04:28:29.098 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-19T04:28:29.123 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-19T04:28:29.151 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-19T04:28:29.190 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-19T04:28:29.358 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:28:29.476 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-19T04:28:29.484 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-19T04:28:29.504 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-19T04:28:29.542 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-common (238) ... 2024-01-19T04:28:29.810 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:28:29.855 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-19T04:28:29.882 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:28:29.921 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:28:30.111 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:28:30.388 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-19T04:28:30.459 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-common. 2024-01-19T04:28:30.487 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-19T04:28:30.544 INFO:teuthology.orchestra.run.smithi133.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-19T04:28:30.582 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-19T04:28:30.693 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-common (238) ... 2024-01-19T04:28:30.850 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-19T04:28:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:28:31.202 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-14. 2024-01-19T04:28:31.231 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:28:31.272 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:28:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:28:31.772 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-19T04:28:32.056 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:28:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:28:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:32.580 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql. 2024-01-19T04:28:32.610 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-19T04:28:32.627 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:32.646 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql (14+238) ... 2024-01-19T04:28:32.762 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:28:32.882 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client. 2024-01-19T04:28:32.898 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-19T04:28:32.941 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client (14+238) ... 2024-01-19T04:28:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:33.117 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-19T04:28:33.134 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-19T04:28:33.167 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-19T04:28:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-19T04:28:33.486 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package tcl8.6. 2024-01-19T04:28:33.515 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-19T04:28:33.553 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:28:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:33.857 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package tcl. 2024-01-19T04:28:33.884 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-19T04:28:33.895 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:34.011 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-19T04:28:34.022 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:34.131 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:34.333 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package wpasupplicant. 2024-01-19T04:28:34.334 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:28:34.335 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:28:34.361 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-19T04:28:34.391 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:28:34.754 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-19T04:28:34.782 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-19T04:28:34.820 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-19T04:28:34.832 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:34.958 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:35.084 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:35.198 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-19T04:28:35.210 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:35.226 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-19T04:28:35.274 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:28:35.345 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:35.471 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:35.569 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-common (238) ... 2024-01-19T04:28:35.597 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:28:35.813 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-19T04:28:35.947 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:28:36.073 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:28:36.216 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:28:36.325 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:28:36.426 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:28:36.734 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:36.860 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:36.917 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-19T04:28:37.006 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:28:37.011 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.146 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.271 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.375 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:28:37.375 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:28:37.389 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.515 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.641 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.767 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.851 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:28:37.893 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:37.968 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:28:38.019 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:38.094 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-19T04:28:38.222 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:28:38.365 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:28:38.482 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:28:38.545 INFO:teuthology.orchestra.run.smithi156.stdout:Adding group ceph....done 2024-01-19T04:28:38.583 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:28:38.922 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user ceph....done 2024-01-19T04:28:39.107 INFO:teuthology.orchestra.run.smithi156.stdout:Setting system user ceph properties....done 2024-01-19T04:28:39.127 INFO:teuthology.orchestra.run.smithi156.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-19T04:28:39.196 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:28:39.268 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-19T04:28:39.323 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up dump (0.4b47-3) ... 2024-01-19T04:28:39.416 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-19T04:28:39.482 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:28:39.583 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:28:39.594 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-19T04:28:39.684 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-19T04:28:39.794 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-19T04:28:39.920 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:28:40.009 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-19T04:28:40.079 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:28:40.113 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:40.206 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:28:40.316 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:28:40.316 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:28:40.382 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:28:40.499 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:28:40.600 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-19T04:28:40.735 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client (14+238) ... 2024-01-19T04:28:40.822 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:40.861 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:28:40.940 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:41.345 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:28:41.346 INFO:teuthology.orchestra.run.smithi133.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-19T04:28:41.346 INFO:teuthology.orchestra.run.smithi133.stdout:which means they are currently configured by ifupdown: 2024-01-19T04:28:41.346 INFO:teuthology.orchestra.run.smithi133.stdout:- enp3s0f1 2024-01-19T04:28:41.346 INFO:teuthology.orchestra.run.smithi133.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-19T04:28:41.346 INFO:teuthology.orchestra.run.smithi133.stdout:remove their configuration from /etc/network/interfaces. 2024-01-19T04:28:41.346 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:28:41.423 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:28:41.423 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:28:41.463 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-19T04:28:41.780 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-19T04:28:41.900 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:42.135 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-19T04:28:42.244 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-19T04:28:42.630 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:28:42.702 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:42.781 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:28:42.907 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-19T04:28:42.913 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:28:42.913 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:28:43.017 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-common (238) ... 2024-01-19T04:28:43.404 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:43.513 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:43.720 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-19T04:28:43.720 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-19T04:28:43.848 INFO:teuthology.orchestra.run.smithi133.stdout:Adding user postgres to group ssl-cert 2024-01-19T04:28:44.104 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:28:44.104 INFO:teuthology.orchestra.run.smithi133.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-19T04:28:44.189 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:44.310 INFO:teuthology.orchestra.run.smithi133.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-19T04:28:44.310 INFO:teuthology.orchestra.run.smithi133.stdout:Removing obsolete dictionary files: 2024-01-19T04:28:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:28:44.408 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:28:44.864 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-19T04:28:44.899 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:45.025 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:45.160 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:45.243 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:28:45.286 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:45.559 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:28:45.559 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:28:45.579 INFO:teuthology.orchestra.run.smithi133.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-19T04:28:45.596 INFO:teuthology.orchestra.run.smithi133.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-19T04:28:45.636 INFO:teuthology.orchestra.run.smithi133.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:This user must also own the server process. 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:The database cluster will be initialized with locale "en_US". 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:The default text search configuration will be set to "english". 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:Data page checksums are disabled. 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:creating subdirectories ... ok 2024-01-19T04:28:45.637 INFO:teuthology.orchestra.run.smithi133.stdout:selecting dynamic shared memory implementation ... posix 2024-01-19T04:28:45.652 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default max_connections ... 100 2024-01-19T04:28:45.672 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default shared_buffers ... 128MB 2024-01-19T04:28:45.681 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default time zone ... Etc/UTC 2024-01-19T04:28:45.682 INFO:teuthology.orchestra.run.smithi133.stdout:creating configuration files ... ok 2024-01-19T04:28:45.797 INFO:teuthology.orchestra.run.smithi133.stdout:running bootstrap script ... ok 2024-01-19T04:28:46.039 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:46.165 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:46.291 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:46.401 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:46.436 INFO:teuthology.orchestra.run.smithi133.stdout:performing post-bootstrap initialization ... ok 2024-01-19T04:28:46.502 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:46.636 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:46.853 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:28:46.853 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:28:47.107 INFO:teuthology.orchestra.run.smithi133.stdout:syncing data to disk ... ok 2024-01-19T04:28:47.345 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:47.476 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-19T04:28:47.497 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:47.623 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:47.791 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:47.917 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:28:48.269 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-19T04:28:48.378 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:28:48.850 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:28:50.083 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:28:50.241 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:28:50.342 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-19T04:28:50.459 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql (14+238) ... 2024-01-19T04:28:50.619 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:28:50.761 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:28:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:28:50.777 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-19T04:28:50.836 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2024-01-19T04:28:51.017 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:28:51.017 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:28:51.026 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2024-01-19T04:28:51.027 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2024-01-19T04:28:51.194 INFO:teuthology.orchestra.run.smithi156.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-19T04:28:51.194 INFO:teuthology.orchestra.run.smithi156.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:28:51.195 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:28:51.196 INFO:teuthology.orchestra.run.smithi156.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:28:51.196 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:28:51.196 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2024-01-19T04:28:51.196 INFO:teuthology.orchestra.run.smithi156.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-19T04:28:51.196 INFO:teuthology.orchestra.run.smithi156.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-19T04:28:51.197 INFO:teuthology.orchestra.run.smithi156.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-19T04:28:51.197 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-19T04:28:51.197 INFO:teuthology.orchestra.run.smithi156.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:28:51.198 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2024-01-19T04:28:51.198 INFO:teuthology.orchestra.run.smithi156.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-19T04:28:51.198 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-19T04:28:51.198 INFO:teuthology.orchestra.run.smithi156.stdout: libengine-pkcs11-openssl 2024-01-19T04:28:51.234 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2024-01-19T04:28:51.235 INFO:teuthology.orchestra.run.smithi156.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-19T04:28:51.235 INFO:teuthology.orchestra.run.smithi156.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-19T04:28:51.236 INFO:teuthology.orchestra.run.smithi156.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-19T04:28:51.236 INFO:teuthology.orchestra.run.smithi156.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-19T04:28:51.236 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-19T04:28:51.236 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-19T04:28:51.236 INFO:teuthology.orchestra.run.smithi156.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:28:51.237 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2024-01-19T04:28:51.237 INFO:teuthology.orchestra.run.smithi156.stdout: libssl3 2024-01-19T04:28:51.416 INFO:teuthology.orchestra.run.smithi156.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2024-01-19T04:28:51.417 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 54.6 MB of archives. 2024-01-19T04:28:51.417 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-19T04:28:51.417 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-19T04:28:51.631 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-19T04:28:51.903 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-19T04:28:51.949 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:28:52.092 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:28:52.161 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-19T04:28:52.194 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-19T04:28:52.196 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-19T04:28:52.201 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-19T04:28:52.205 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-19T04:28:52.206 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-19T04:28:52.209 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-19T04:28:52.211 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-19T04:28:52.211 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-19T04:28:52.377 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-19T04:28:52.699 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-19T04:28:53.445 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-19T04:28:53.545 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:28:53.898 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-19T04:28:53.934 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-19T04:28:53.935 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-19T04:28:53.946 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-19T04:28:53.948 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-19T04:28:53.962 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-19T04:28:53.966 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-19T04:28:53.982 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-19T04:28:53.983 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-19T04:28:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:28:54.030 DEBUG:teuthology.parallel:result is None 2024-01-19T04:28:54.205 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-19T04:28:54.289 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-19T04:28:54.771 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-19T04:28:54.901 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-19T04:28:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-19T04:28:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-19T04:28:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-19T04:28:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-19T04:28:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-19T04:28:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-19T04:28:55.505 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-19T04:28:55.688 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-19T04:28:55.771 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-19T04:28:55.771 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-19T04:28:55.856 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-19T04:28:55.866 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-19T04:28:56.330 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-19T04:28:56.334 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-19T04:28:56.740 INFO:teuthology.orchestra.run.smithi156.stdout:Preconfiguring packages ... 2024-01-19T04:28:56.883 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 54.6 MB in 5s (10.7 MB/s) 2024-01-19T04:28:57.041 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package flex. 2024-01-19T04:28:57.137 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173925 files and directories currently installed.) 2024-01-19T04:28:57.142 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-19T04:28:57.189 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-19T04:28:57.697 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:28:57.845 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-19T04:28:58.255 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:28:58.746 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package bison. 2024-01-19T04:28:58.848 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173998 files and directories currently installed.) 2024-01-19T04:28:58.854 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-19T04:28:58.898 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:28:59.341 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-19T04:28:59.384 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-19T04:28:59.399 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:28:59.719 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package dump. 2024-01-19T04:28:59.747 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-19T04:28:59.785 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking dump (0.4b47-3) ... 2024-01-19T04:29:00.073 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package indent. 2024-01-19T04:29:00.100 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:29:00.139 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:29:00.400 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-19T04:29:00.416 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-19T04:29:00.458 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:29:00.787 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-19T04:29:00.814 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-19T04:29:00.853 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:29:01.114 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-19T04:29:01.130 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-19T04:29:01.173 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:29:01.509 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-19T04:29:01.537 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-19T04:29:01.575 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:29:01.811 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-19T04:29:01.827 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-19T04:29:01.861 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:29:02.147 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjson-perl. 2024-01-19T04:29:02.163 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-19T04:29:02.206 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-19T04:29:02.517 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-19T04:29:02.545 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-19T04:29:02.584 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:29:04.219 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-19T04:29:04.247 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:29:04.286 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:29:04.573 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-19T04:29:04.589 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:29:04.631 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:29:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-19T04:29:04.978 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:29:05.017 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:29:05.344 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-19T04:29:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-19T04:29:05.411 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:29:05.756 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-19T04:29:05.783 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:29:05.822 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:29:06.175 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-19T04:29:06.202 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:29:06.241 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:29:06.602 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-19T04:29:06.630 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:29:06.669 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:29:06.980 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-19T04:29:07.008 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:29:07.038 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:29:07.290 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-19T04:29:07.306 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:29:07.348 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:29:07.860 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-19T04:29:07.888 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-19T04:29:07.927 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:29:08.288 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package modemmanager. 2024-01-19T04:29:08.316 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:29:08.363 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:29:08.969 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package network-manager. 2024-01-19T04:29:08.997 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:29:09.044 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:29:09.803 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ppp. 2024-01-19T04:29:09.831 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-19T04:29:10.100 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:29:10.399 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package pptp-linux. 2024-01-19T04:29:10.415 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-19T04:29:10.457 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-19T04:29:10.693 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-19T04:29:10.709 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-19T04:29:10.751 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-19T04:29:11.054 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-19T04:29:11.082 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-19T04:29:11.121 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client-common (238) ... 2024-01-19T04:29:11.399 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-19T04:29:11.427 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:29:11.466 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:29:12.046 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-common. 2024-01-19T04:29:12.074 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-19T04:29:12.130 INFO:teuthology.orchestra.run.smithi156.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-19T04:29:12.160 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-common (238) ... 2024-01-19T04:29:12.594 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-14. 2024-01-19T04:29:12.622 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:29:12.664 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:29:14.097 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql. 2024-01-19T04:29:14.126 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-19T04:29:14.164 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql (14+238) ... 2024-01-19T04:29:14.407 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client. 2024-01-19T04:29:14.424 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-19T04:29:14.466 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client (14+238) ... 2024-01-19T04:29:14.693 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-19T04:29:14.709 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-19T04:29:14.751 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-19T04:29:15.070 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package tcl8.6. 2024-01-19T04:29:15.098 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-19T04:29:15.136 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:29:15.414 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package tcl. 2024-01-19T04:29:15.442 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-19T04:29:15.486 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package wpasupplicant. 2024-01-19T04:29:15.862 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-19T04:29:15.900 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:29:16.255 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-19T04:29:16.271 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-19T04:29:16.313 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-19T04:29:16.708 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-19T04:29:16.736 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-19T04:29:16.783 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:29:17.079 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client-common (238) ... 2024-01-19T04:29:17.288 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-19T04:29:17.423 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:29:17.540 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:29:17.666 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:29:17.792 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:29:17.918 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:29:18.378 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-19T04:29:18.465 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:29:18.846 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:29:18.846 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:29:19.336 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:29:19.461 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:29:19.588 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-19T04:29:19.812 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:29:20.248 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:29:20.349 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:29:20.475 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:29:21.239 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:29:21.340 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up dump (0.4b47-3) ... 2024-01-19T04:29:21.417 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-19T04:29:21.484 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:29:21.610 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:29:21.736 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-19T04:29:21.861 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-19T04:29:21.988 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:29:22.077 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-19T04:29:22.139 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:29:22.240 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:29:22.383 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:29:22.509 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:29:22.635 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-19T04:29:22.804 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client (14+238) ... 2024-01-19T04:29:22.929 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout:which means they are currently configured by ifupdown: 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout:- enp3s0f1 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout:remove their configuration from /etc/network/interfaces. 2024-01-19T04:29:23.416 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:23.537 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-19T04:29:23.864 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-19T04:29:24.203 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-19T04:29:24.665 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:29:24.792 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:29:24.918 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-19T04:29:25.227 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-common (238) ... 2024-01-19T04:29:26.404 INFO:teuthology.orchestra.run.smithi156.stdout:Adding user postgres to group ssl-cert 2024-01-19T04:29:26.635 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:26.636 INFO:teuthology.orchestra.run.smithi156.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-19T04:29:26.830 INFO:teuthology.orchestra.run.smithi156.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-19T04:29:26.831 INFO:teuthology.orchestra.run.smithi156.stdout:Removing obsolete dictionary files: 2024-01-19T04:29:27.394 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-19T04:29:27.770 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:29:28.094 INFO:teuthology.orchestra.run.smithi156.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-19T04:29:28.119 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout:This user must also own the server process. 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout:The database cluster will be initialized with locale "en_US". 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout:The default text search configuration will be set to "english". 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:28.176 INFO:teuthology.orchestra.run.smithi156.stdout:Data page checksums are disabled. 2024-01-19T04:29:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:28.177 INFO:teuthology.orchestra.run.smithi156.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-19T04:29:28.177 INFO:teuthology.orchestra.run.smithi156.stdout:creating subdirectories ... ok 2024-01-19T04:29:28.177 INFO:teuthology.orchestra.run.smithi156.stdout:selecting dynamic shared memory implementation ... posix 2024-01-19T04:29:28.192 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default max_connections ... 100 2024-01-19T04:29:28.209 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default shared_buffers ... 128MB 2024-01-19T04:29:28.223 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default time zone ... Etc/UTC 2024-01-19T04:29:28.224 INFO:teuthology.orchestra.run.smithi156.stdout:creating configuration files ... ok 2024-01-19T04:29:28.340 INFO:teuthology.orchestra.run.smithi156.stdout:running bootstrap script ... ok 2024-01-19T04:29:29.053 INFO:teuthology.orchestra.run.smithi156.stdout:performing post-bootstrap initialization ... ok 2024-01-19T04:29:29.717 INFO:teuthology.orchestra.run.smithi156.stdout:syncing data to disk ... ok 2024-01-19T04:29:30.100 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-19T04:29:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:29:32.961 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-19T04:29:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql (14+238) ... 2024-01-19T04:29:33.214 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:29:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:29:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:29:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:29:34.076 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-19T04:29:34.428 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:29:34.580 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:29:35.892 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-19T04:29:35.975 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:29:36.464 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:29:36.469 DEBUG:teuthology.parallel:result is None 2024-01-19T04:29:36.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:29:36.686 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2024-01-19T04:29:36.706 INFO:teuthology.orchestra.run.smithi133.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:29:36.707 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:29:36.707 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-19T04:29:36.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:29:36.878 DEBUG:teuthology.orchestra.run.smithi156:> dpkg-query -W -f '${Version}' ceph 2024-01-19T04:29:36.897 INFO:teuthology.orchestra.run.smithi156.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:29:36.898 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:29:36.898 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-19T04:29:36.899 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-19T04:29:36.900 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:36.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-19T04:29:36.914 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:36.914 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-19T04:29:36.955 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-19T04:29:36.955 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:36.955 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-01-19T04:29:36.970 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-19T04:29:37.025 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:37.025 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2024-01-19T04:29:37.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-19T04:29:37.093 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-19T04:29:37.093 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:37.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-19T04:29:37.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-19T04:29:37.160 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:37.161 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-19T04:29:37.174 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-19T04:29:37.228 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-19T04:29:37.229 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:37.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-01-19T04:29:37.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-19T04:29:37.297 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:37.297 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2024-01-19T04:29:37.311 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-19T04:29:37.365 INFO:teuthology.run_tasks:Running task ceph... 2024-01-19T04:29:37.449 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-19T04:29:37.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-01-19T04:29:37.452 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2024-01-19T04:29:37.465 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-19T04:29:37.465 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-19T04:29:37.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-19T04:29:37.521 INFO:tasks.ceph:Creating extra log directories... 2024-01-19T04:29:37.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-19T04:29:37.563 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-19T04:29:37.584 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-19T04:29:37.585 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-19T04:29:37.585 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-19T04:29:37.585 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:37.585 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-19T04:29:37.622 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-19T04:29:37.697 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:37.697 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-19T04:29:37.703 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-19T04:29:37.781 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-19T04:29:37.781 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-19T04:29:37.782 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997', 'branch': 'wip-yuri8-testing-2024-01-18-0823', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7520997', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2024-01-18-0823'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2024-01-18-0823', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6631, 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2024-01-18-0823', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKl0Q+xC6TnJKR6NvnrNEOAuT+b5nfOqItDsKCd1YHs7HCzF1zWbQmAkVdX8PQKFrvJUEvNLs0gv/l+XFF3Je6k=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuB7JWfd3WQcQkOFKGQLetrP1fsVFkZ2HXq4LEtrduNA9tmMQOkalCgv1HcsK8/Jlr+pnNsg2yBh/cxozRnb1M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-18_21:19:14', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-19T04:29:37.782 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-19T04:29:37.785 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-19T04:29:37.822 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-01-19T04:29:37.831 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2024-01-19T04:29:37.878 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:37.878 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-01-19T04:29:37.890 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-19T04:29:37.890 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-01-19T04:29:37.938 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-19T04:29:37.938 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:37.938 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-01-19T04:29:37.938 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:37.939 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-19 04:18:14.255696364 +0000 2024-01-19T04:29:37.939 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-19 04:18:13.995698684 +0000 2024-01-19T04:29:37.939 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-19 04:18:13.995698684 +0000 2024-01-19T04:29:37.939 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-19T04:29:37.939 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-19T04:29:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-19T04:29:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-19T04:29:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000421434 s, 1.2 MB/s 2024-01-19T04:29:37.993 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-19T04:29:38.043 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-01-19T04:29:38.090 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-19T04:29:38.090 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:38.091 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-01-19T04:29:38.091 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:38.091 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-19 04:18:14.735692083 +0000 2024-01-19T04:29:38.091 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-19 04:18:14.479694368 +0000 2024-01-19T04:29:38.091 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-19 04:18:14.479694368 +0000 2024-01-19T04:29:38.091 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-19T04:29:38.091 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-19T04:29:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-19T04:29:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-19T04:29:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000323991 s, 1.6 MB/s 2024-01-19T04:29:38.146 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-19T04:29:38.195 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-19 04:18:15.203687908 +0000 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-19 04:18:14.959690084 +0000 2024-01-19T04:29:38.242 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-19 04:18:14.959690084 +0000 2024-01-19T04:29:38.243 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-19T04:29:38.243 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-19T04:29:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-19T04:29:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-19T04:29:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000406754 s, 1.3 MB/s 2024-01-19T04:29:38.297 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-19T04:29:38.347 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-19 04:18:15.699683484 +0000 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-19 04:18:15.427685909 +0000 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-19 04:18:15.427685909 +0000 2024-01-19T04:29:38.394 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-19T04:29:38.395 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-19T04:29:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-19T04:29:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-19T04:29:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000392264 s, 1.3 MB/s 2024-01-19T04:29:38.449 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-19T04:29:38.499 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:38.499 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:38.499 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2024-01-19T04:29:38.505 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-19T04:29:38.505 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2024-01-19T04:29:38.554 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-19T04:29:38.554 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:38.555 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-01-19T04:29:38.555 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:38.555 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-01-19 04:18:17.119840158 +0000 2024-01-19T04:29:38.555 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-01-19 04:18:16.859842479 +0000 2024-01-19T04:29:38.555 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-01-19 04:18:16.859842479 +0000 2024-01-19T04:29:38.555 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2024-01-19T04:29:38.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-19T04:29:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-01-19T04:29:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-01-19T04:29:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000319073 s, 1.6 MB/s 2024-01-19T04:29:38.610 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-19T04:29:38.661 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2024-01-19T04:29:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-19T04:29:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:38.711 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-01-19T04:29:38.711 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:38.711 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-01-19 04:18:17.631835591 +0000 2024-01-19T04:29:38.711 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-01-19 04:18:17.367837946 +0000 2024-01-19T04:29:38.711 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-01-19 04:18:17.367837946 +0000 2024-01-19T04:29:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2024-01-19T04:29:38.711 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-19T04:29:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-01-19T04:29:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-01-19T04:29:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000247743 s, 2.1 MB/s 2024-01-19T04:29:38.770 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-19T04:29:38.819 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-01-19 04:18:18.099831416 +0000 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-01-19 04:18:17.835833771 +0000 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-01-19 04:18:17.835833771 +0000 2024-01-19T04:29:38.866 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2024-01-19T04:29:38.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-19T04:29:38.920 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-01-19T04:29:38.920 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-01-19T04:29:38.921 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00024554 s, 2.1 MB/s 2024-01-19T04:29:38.921 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-19T04:29:38.971 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-01-19 04:18:18.303829596 +0000 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-01-19 04:18:18.299829633 +0000 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-01-19 04:18:18.299829633 +0000 2024-01-19T04:29:39.018 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2024-01-19T04:29:39.019 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-19T04:29:39.072 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-01-19T04:29:39.072 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-01-19T04:29:39.072 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000256888 s, 2.0 MB/s 2024-01-19T04:29:39.074 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-19T04:29:39.123 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:39.123 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-19T04:29:39.123 INFO:tasks.ceph:Generating config... 2024-01-19T04:29:39.125 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-19T04:29:39.125 INFO:tasks.ceph:[client] debug client = 20 2024-01-19T04:29:39.125 INFO:tasks.ceph:[client] debug ms = 1 2024-01-19T04:29:39.125 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-19T04:29:39.125 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-19T04:29:39.126 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-01-19T04:29:39.126 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-01-19T04:29:39.126 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-19T04:29:39.126 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-19T04:29:39.127 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-19T04:29:39.127 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-19T04:29:39.127 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-19T04:29:39.127 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-19T04:29:39.127 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-19T04:29:39.127 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-19T04:29:39.127 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-19T04:29:39.128 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-19T04:29:39.128 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-19T04:29:39.128 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-19T04:29:39.128 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-19T04:29:39.128 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-19T04:29:39.128 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-19T04:29:39.128 INFO:tasks.ceph:Setting up mon.a... 2024-01-19T04:29:39.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-19T04:29:39.163 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2024-01-19T04:29:39.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-19T04:29:39.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T04:29:39.373 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.156'), ('mon.c', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]')] 2024-01-19T04:29:39.374 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-19T04:29:39.374 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:39.375 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-19T04:29:39.422 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.156 --addv c '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:39.506 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:39.506 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid d3166d6e-d1d2-4f45-9af8-af169e4e9af8 2024-01-19T04:29:39.506 INFO:teuthology.orchestra.run.smithi133.stdout:setting min_mon_release = quincy 2024-01-19T04:29:39.506 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2024-01-19T04:29:39.506 INFO:teuthology.orchestra.run.smithi133.stdout:fsid d3166d6e-d1d2-4f45-9af8-af169e4e9af8 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2024-01-19T04:29:39.507653+0000 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:created 2024-01-19T04:29:39.507653+0000 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 17 (quincy) 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.c 2024-01-19T04:29:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-19T04:29:39.508 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-19T04:29:39.554 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d3166d6e-d1d2-4f45-9af8-af169e4e9af8... 2024-01-19T04:29:39.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-19T04:29:39.599 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-19T04:29:39.627 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-01-19T04:29:39.627 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-01-19T04:29:39.627 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-19T04:29:39.627 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-19T04:29:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-01-19T04:29:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.630 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: mds beacon grace = 60 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: mds heartbeat grace = 60 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: osd heartbeat grace = 60 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = d3166d6e-d1d2-4f45-9af8-af169e4e9af8 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug trim objects = true 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-01-19T04:29:39.632 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-01-19T04:29:39.633 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: osd fast shutdown = False 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-01-19T04:29:39.634 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-01-19T04:29:39.635 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-19T04:29:39.636 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd crush smoke test = False 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-19T04:29:39.637 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.e] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.f] 2024-01-19T04:29:39.638 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: mds valgrind exit = True 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-01-19T04:29:39.639 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2024-01-19T04:29:39.641 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2024-01-19T04:29:39.642 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.643 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.133,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: mds beacon grace = 60 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: mds heartbeat grace = 60 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: osd heartbeat grace = 60 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = d3166d6e-d1d2-4f45-9af8-af169e4e9af8 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.644 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug trim objects = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2024-01-19T04:29:39.645 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2024-01-19T04:29:39.646 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 20 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 20 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 10 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: osd fast shutdown = False 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-01-19T04:29:39.647 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2024-01-19T04:29:39.648 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2024-01-19T04:29:39.649 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: mon op complaint time = 120 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd crush smoke test = False 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: client mount timeout = 600 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2024-01-19T04:29:39.650 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.e] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.f] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds = 20 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds balancer = 20 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-01-19T04:29:39.651 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug frag = True 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug scatterstat = True 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: mds op complaint time = 180 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: mds valgrind exit = True 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: mds verify scatter = True 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2024-01-19T04:29:39.652 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2024-01-19T04:29:39.652 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-19T04:29:39.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-19T04:29:39.735 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-19T04:29:39.735 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:39.735 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-19T04:29:39.741 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:39.741 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-19T04:29:39.791 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:29:39.791 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:39.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-19T04:29:39.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T04:29:39.854 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:29:39.854 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:39.902 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T04:29:39.902 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:39.902 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-19T04:29:39.902 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T04:29:39.925 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:29:39.925 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:39.974 INFO:tasks.ceph:Setting up mon nodes... 2024-01-19T04:29:39.974 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-19T04:29:39.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-19T04:29:40.015 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-19T04:29:40.018 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-19T04:29:40.061 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-19T04:29:40.074 INFO:tasks.ceph:Setting up mds nodes... 2024-01-19T04:29:40.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-19T04:29:40.119 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-19T04:29:40.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-19T04:29:40.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-19T04:29:40.262 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-19T04:29:40.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-19T04:29:40.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-01-19T04:29:40.401 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-01-19T04:29:40.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-01-19T04:29:40.457 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-19T04:29:40.501 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-19T04:29:40.504 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-19T04:29:40.516 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-19T04:29:40.597 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-19T04:29:40.600 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-19T04:29:40.653 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-01-19T04:29:40.738 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-01-19T04:29:40.740 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-01-19T04:29:40.794 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-19T04:29:40.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-19T04:29:40.829 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-19T04:29:40.840 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-19T04:29:40.840 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-19T04:29:40.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-19T04:29:40.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:40.893 INFO:tasks.ceph:role: osd.0 2024-01-19T04:29:40.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:29:40.893 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-19T04:29:40.957 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:40.957 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:40.958 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:41.417 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-19T04:29:41.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-19T04:29:41.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-19T04:29:41.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-19T04:29:41.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:41.553 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:41.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-19T04:29:41.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:41.607 INFO:tasks.ceph:role: osd.1 2024-01-19T04:29:41.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:29:41.608 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-19T04:29:41.669 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:41.670 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:41.670 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:41.670 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:41.670 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:42.101 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-19T04:29:42.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-19T04:29:42.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-19T04:29:42.169 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-19T04:29:42.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:42.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-19T04:29:42.277 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:42.277 INFO:tasks.ceph:role: osd.2 2024-01-19T04:29:42.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:29:42.277 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:42.346 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:42.347 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:42.347 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:42.810 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-19T04:29:42.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-19T04:29:42.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-19T04:29:42.903 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-19T04:29:42.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:42.913 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:42.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-19T04:29:42.968 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:42.968 INFO:tasks.ceph:role: osd.3 2024-01-19T04:29:42.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:29:42.968 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-19T04:29:43.030 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:43.030 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:43.030 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:43.031 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:43.486 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-19T04:29:43.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-19T04:29:43.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-19T04:29:43.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-19T04:29:43.638 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:43.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:43.639 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:43.839+0000 7f4fefc7f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-19T04:29:43.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:43.847+0000 7f4fefc7f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-19T04:29:43.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:43.847+0000 7f4fefc7f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T04:29:43.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:43.847+0000 7f4fefc7f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T04:29:43.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:43.847+0000 7f4fefc7f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T04:29:43.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:43.851+0000 7f4fefc7f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-19T04:29:46.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-19T04:29:46.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:46.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:46.927+0000 7f8146cce640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-19T04:29:46.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:46.927+0000 7f8146cce640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-19T04:29:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:46.927+0000 7f8146cce640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T04:29:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:46.927+0000 7f8146cce640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T04:29:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:46.927+0000 7f8146cce640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T04:29:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:46.927+0000 7f8146cce640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-19T04:29:49.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-19T04:29:49.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:50.039+0000 7fe31cf9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-19T04:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:50.039+0000 7fe31cf9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-19T04:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:50.039+0000 7fe31cf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T04:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:50.039+0000 7fe31cf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T04:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:50.039+0000 7fe31cf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T04:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:50.039+0000 7fe31cf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-19T04:29:53.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-19T04:29:53.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:53.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:53.171+0000 7fbf77d57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-19T04:29:53.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:53.171+0000 7fbf77d57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-19T04:29:53.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:53.171+0000 7fbf77d57640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T04:29:53.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:53.171+0000 7fbf77d57640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T04:29:53.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:53.171+0000 7fbf77d57640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T04:29:53.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:29:53.175+0000 7fbf77d57640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-19T04:29:56.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-19T04:29:56.199 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-19T04:29:56.214 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:56.214 INFO:tasks.ceph:role: osd.4 2024-01-19T04:29:56.214 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T04:29:56.214 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-19T04:29:56.269 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:56.270 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:56.295 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-01-19T04:29:56.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-01-19T04:29:56.296 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-19T04:29:56.353 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-19T04:29:56.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:56.406 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-19T04:29:56.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:56.459 INFO:tasks.ceph:role: osd.5 2024-01-19T04:29:56.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T04:29:56.459 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-19T04:29:56.513 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:56.514 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:56.514 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:56.514 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:56.514 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:56.536 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-01-19T04:29:56.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-01-19T04:29:56.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-19T04:29:56.596 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-19T04:29:56.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:56.647 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:56.647 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-19T04:29:56.702 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:56.702 INFO:tasks.ceph:role: osd.6 2024-01-19T04:29:56.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T04:29:56.702 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:56.758 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:56.759 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:56.782 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-01-19T04:29:56.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-01-19T04:29:56.784 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-19T04:29:56.843 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-19T04:29:56.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:56.894 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-19T04:29:56.951 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:29:56.951 INFO:tasks.ceph:role: osd.7 2024-01-19T04:29:56.951 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T04:29:56.952 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:29:57.008 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:29:57.032 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-01-19T04:29:57.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-01-19T04:29:57.034 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-19T04:29:57.092 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-19T04:29:57.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:29:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:29:57.142 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:29:57.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:29:57.243+0000 7f9cf7243640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-19T04:29:57.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:29:57.243+0000 7f9cf7243640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-19T04:29:57.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:29:57.243+0000 7f9cf7243640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T04:29:57.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:29:57.243+0000 7f9cf7243640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T04:29:57.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:29:57.243+0000 7f9cf7243640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T04:29:57.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:29:57.243+0000 7f9cf7243640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-19T04:30:00.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-19T04:30:00.239 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:30:00.319 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:00.315+0000 7f23b9194640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-19T04:30:00.319 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:00.315+0000 7f23b9194640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-19T04:30:00.320 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:00.315+0000 7f23b9194640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T04:30:00.320 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:00.315+0000 7f23b9194640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T04:30:00.320 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:00.315+0000 7f23b9194640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T04:30:00.320 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:00.315+0000 7f23b9194640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-19T04:30:03.278 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-19T04:30:03.334 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:30:03.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:03.419+0000 7fcff365f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-19T04:30:03.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:03.419+0000 7fcff365f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-19T04:30:03.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:03.419+0000 7fcff365f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T04:30:03.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:03.419+0000 7fcff365f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T04:30:03.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:03.419+0000 7fcff365f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T04:30:03.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:03.419+0000 7fcff365f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-19T04:30:06.385 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-19T04:30:06.442 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:30:06.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:06.518+0000 7f8dd6fad640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-19T04:30:06.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:06.518+0000 7f8dd6fad640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-19T04:30:06.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:06.518+0000 7f8dd6fad640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T04:30:06.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:06.518+0000 7f8dd6fad640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T04:30:06.524 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:06.518+0000 7f8dd6fad640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T04:30:06.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:06.518+0000 7f8dd6fad640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-19T04:30:07.783 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:30:07.786 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:30:09.513 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-19T04:30:09.527 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-19T04:30:09.527 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-19T04:30:09.541 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-19T04:30:09.597 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-19T04:30:09.657 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-01-19T04:30:09.713 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-19T04:30:09.768 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.768 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-19T04:30:09.821 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-19T04:30:09.876 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:09.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-19T04:30:09.928 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:09.928 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-19T04:30:09.942 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:09.942 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-19T04:30:09.997 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:09.998 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-19T04:30:10.059 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:10.059 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-01-19T04:30:10.114 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:10.114 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-19T04:30:10.169 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:10.169 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-19T04:30:10.225 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:10.225 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-19T04:30:10.281 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:10.281 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-19T04:30:10.337 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:10.337 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-19T04:30:10.343 INFO:tasks.ceph:Adding keys to all mons... 2024-01-19T04:30:10.343 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-19T04:30:10.387 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllxHAGARAAomQFtjK2F0I1oJNwSfGzdQ== 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qll3rI1BxAAP0sKmgtZB4Co7tiileLwQQ== 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllg6C0DxAASwkDLwGG4zS6Oe8+u6TvuQ== 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.e] 2024-01-19T04:30:10.396 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllhJUCGBAABDHrYgb4etqjmvR3C+rYqA== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC3+qlliQlaMhAAkpYbvbXr6o8dopx7bqh/QA== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC6+qllXielNxAAYngEo85Bm595Ojue9BIIFw== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC++qllP4GcAhAAeComomvH9VVMP6xCm7Bn5g== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDB+qlltAiZChAAuK9jml/fXdATnXzKCLJuJA== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllxRi9AxAAJSQ34s2qZd9JpANpj1JibQ== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllCLX5HRAAHpRZH18CaRUTse4lWHKTFA== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qlludirIxAAsUFYd1UI7aEuR2bvVamQiQ== 2024-01-19T04:30:10.397 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.f] 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllJXAQLBAA9TqdH0bBfP4fFUbMZQSj9A== 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDF+qllS+C8DhAAFI9kiNwoeNreB52KrocLWw== 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDI+qll44QXExAA7VbjsExt3yBT+3qSLckMQw== 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDL+qllfTM/GRAA4pir6zg8UQaI/jYxdEBF8w== 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDO+qll9K1NHxAA320xSFCA2q5wF38usN6GZQ== 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2024-01-19T04:30:10.398 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC0+qllWqKFMRAAvc7VskAPK8NaJ5SqYauXXg== 2024-01-19T04:30:10.399 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllxHAGARAAomQFtjK2F0I1oJNwSfGzdQ== 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qll3rI1BxAAP0sKmgtZB4Co7tiileLwQQ== 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllg6C0DxAASwkDLwGG4zS6Oe8+u6TvuQ== 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.e] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllhJUCGBAABDHrYgb4etqjmvR3C+rYqA== 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC3+qlliQlaMhAAkpYbvbXr6o8dopx7bqh/QA== 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC6+qllXielNxAAYngEo85Bm595Ojue9BIIFw== 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2024-01-19T04:30:10.400 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC++qllP4GcAhAAeComomvH9VVMP6xCm7Bn5g== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDB+qlltAiZChAAuK9jml/fXdATnXzKCLJuJA== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllxRi9AxAAJSQ34s2qZd9JpANpj1JibQ== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllCLX5HRAAHpRZH18CaRUTse4lWHKTFA== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qlludirIxAAsUFYd1UI7aEuR2bvVamQiQ== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.f] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllJXAQLBAA9TqdH0bBfP4fFUbMZQSj9A== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDF+qllS+C8DhAAFI9kiNwoeNreB52KrocLWw== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDI+qll44QXExAA7VbjsExt3yBT+3qSLckMQw== 2024-01-19T04:30:10.401 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2024-01-19T04:30:10.402 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDL+qllfTM/GRAA4pir6zg8UQaI/jYxdEBF8w== 2024-01-19T04:30:10.402 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2024-01-19T04:30:10.402 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDO+qll9K1NHxAA320xSFCA2q5wF38usN6GZQ== 2024-01-19T04:30:10.402 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2024-01-19T04:30:10.402 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC0+qllWqKFMRAAvc7VskAPK8NaJ5SqYauXXg== 2024-01-19T04:30:10.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:30:10.447 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:30:10.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:10.537 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:10.587 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:10.589 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:10.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:10.675 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:10.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.723 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.807 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.810 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.852 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:10.979 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:30:11.059 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:30:11.108 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:11.143 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:11.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:11.198 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:11.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:11.283 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:30:11.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.330 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.503 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.595 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.597 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:30:11.639 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T04:30:11.683 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T04:30:11.729 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-19T04:30:11.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-19T04:30:11.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T04:30:11.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-19T04:30:11.885 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-19T04:30:11.899 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T04:30:11.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-19T04:30:12.001 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-19T04:30:12.055 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T04:30:12.149 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-19T04:30:12.160 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:30:12.162 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:30:12.205 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-19T04:30:12.205 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-19T04:30:12.205 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-19T04:30:12.205 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-19T04:30:12.210 INFO:tasks.ceph.mon.a:Started 2024-01-19T04:30:12.211 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-19T04:30:12.211 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-19T04:30:12.211 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-19T04:30:12.251 INFO:tasks.ceph.mon.b:Started 2024-01-19T04:30:12.252 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-19T04:30:12.252 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-19T04:30:12.252 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-19T04:30:12.254 INFO:tasks.ceph.mon.c:Started 2024-01-19T04:30:12.254 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-19T04:30:12.255 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-19T04:30:12.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-19T04:30:12.257 INFO:tasks.ceph.mgr.y:Started 2024-01-19T04:30:12.257 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-19T04:30:12.258 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-19T04:30:12.260 INFO:tasks.ceph.mgr.x:Started 2024-01-19T04:30:12.260 INFO:tasks.ceph:Setting crush tunables to default 2024-01-19T04:30:12.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2024-01-19T04:30:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa869491640 1 Processor -- start 2024-01-19T04:30:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa869491640 1 -- start start 2024-01-19T04:30:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa869491640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 0x7fa8640c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa869491640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86406ca80 con 0x7fa86406c5b0 2024-01-19T04:30:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa869491640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640c3fa0 con 0x7fa8640728a0 2024-01-19T04:30:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa869491640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86415db50 con 0x7fa864153860 2024-01-19T04:30:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa862ffd640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 msgr2=0x7fa8640c4d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa862ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 0x7fa8640c4d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8640728a0 legacy=0x7fa864159c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.371+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa86406c5b0 legacy=0x7fa864159520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:12.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.575+0000 7fa862ffd640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 msgr2=0x7fa8640c4d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:12.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.575+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa86406c5b0 legacy=0x7fa864159520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:12.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.575+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8640728a0 legacy=0x7fa864159c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:12.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.575+0000 7fa862ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 0x7fa8640c4d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:12.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.979+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa86406c5b0 legacy=0x7fa864159520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.979+0000 7fa862ffd640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 msgr2=0x7fa8640c4d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.979+0000 7fa862ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 0x7fa8640c4d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:12.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:12.979+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8640728a0 legacy=0x7fa864159c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:13.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:13.783+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa86406c5b0 legacy=0x7fa864159520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:13.783+0000 7fa862ffd640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 msgr2=0x7fa8640c4d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:13.783+0000 7fa862ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 0x7fa8640c4d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:13.783+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8640728a0 legacy=0x7fa864159c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:15.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.371+0000 7fa8617fa640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 msgr2=0x7fa8640c4d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:15.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.371+0000 7fa8617fa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa864153860 0x7fa8640c4d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:15.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.371+0000 7fa8617fa640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8640728a0 legacy=0x7fa864159c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:15.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.371+0000 7fa8617fa640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa86406c5b0 legacy=0x7fa864159520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.371+0000 7fa8617fa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 0x7fa844005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa8617fa640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 0x7fa844008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa8617fa640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86415db50 con 0x7fa8440061d0 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa8617fa640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844008d40 con 0x7fa8440036b0 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa85a7fc640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 msgr2=0x7fa844008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 msgr2=0x7fa844005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 0x7fa844008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.375+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 0x7fa844005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:15.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.579+0000 7fa85a7fc640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 msgr2=0x7fa844008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:15.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.579+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 msgr2=0x7fa844005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:15.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.579+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 0x7fa844008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:15.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.579+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 0x7fa844005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:15.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.983+0000 7fa85a7fc640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 msgr2=0x7fa844008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:15.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.983+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 0x7fa844008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:15.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.983+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 msgr2=0x7fa844005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:15.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:15.983+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 0x7fa844005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:16.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:16.787+0000 7fa85a7fc640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 msgr2=0x7fa844008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:16.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:16.787+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 msgr2=0x7fa844005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:16.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:16.787+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 0x7fa844008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:16.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:16.787+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 0x7fa844005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:18.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 msgr2=0x7fa844005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:18.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8440036b0 0x7fa844005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:18.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 msgr2=0x7fa844008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:18.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8440061d0 0x7fa844008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:18.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8637fe640 1 -- reap_dead start 2024-01-19T04:30:18.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa844006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 0x7fa844006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640c4280 con 0x7fa8440074e0 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86415db50 con 0x7fa844006b40 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8617fa640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844008d40 con 0x7fa844003af0 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa844006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa85a7fc640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 msgr2=0x7fa844006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8440074e0 legacy=0x7fa844007990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:18.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa844006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:18.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.375+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 0x7fa844006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:18.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.579+0000 7fa85a7fc640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 msgr2=0x7fa844006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:18.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.579+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa844006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:18.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.579+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 0x7fa844006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:18.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.579+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa844006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:18.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.579+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8440074e0 legacy=0x7fa844007990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:18.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.983+0000 7fa85a7fc640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 msgr2=0x7fa844006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:18.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.983+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8440074e0 legacy=0x7fa844007990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:18.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.983+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa844006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.983+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 0x7fa844006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:18.983+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa844006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:19.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:19.787+0000 7fa85a7fc640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 msgr2=0x7fa844006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.133:3300/0 2024-01-19T04:30:19.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:19.787+0000 7fa85a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 0x7fa844006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:19.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:19.787+0000 7fa8637fe640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8440074e0 legacy=0x7fa844007990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2024-01-19T04:30:19.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:19.787+0000 7fa862ffd640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa844006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3301/0 2024-01-19T04:30:19.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:19.787+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa844006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:20.525 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:00:08.133 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:30:20.529 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:00:08.139 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:30:20.586 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:00:08.210 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:30:20.850 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:00:08.459 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:30:20.867 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:00:08.476 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:30:20.908 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:00:08.533 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:30:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 -- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa844006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa844006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 -- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 msgr2=0x7fa844006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa844006b40 0x7fa844006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7fa8440074e0 legacy=0x7fa844007990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86406ca80 con 0x7fa844010580 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa8617fa640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86415db50 con 0x7fa844008460 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa844010580 legacy=0x7fa844012970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa862ffd640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 msgr2=0x7fa844010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.375+0000 7fa862ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:21.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.579+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa844010580 legacy=0x7fa844012970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:21.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.579+0000 7fa862ffd640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 msgr2=0x7fa844010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:21.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.579+0000 7fa862ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:21.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.983+0000 7fa85a7fc640 1 -- >> v1:172.21.15.133:6789/0 conn(0x7fa844010580 legacy=0x7fa844012970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.133:6789/0 2024-01-19T04:30:21.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.983+0000 7fa862ffd640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 msgr2=0x7fa844010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2024-01-19T04:30:21.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:21.983+0000 7fa862ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:23.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.099+0000 7fa862ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:23.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.099+0000 7fa862ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:34882/0 (socket says 172.21.15.133:34882) 2024-01-19T04:30:23.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.099+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 learned_addr learned my addr 172.21.15.133:0/468692273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.195+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 msgr2=0x7fa844010040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:30:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.195+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 msgr2=0x7fa844010040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.195+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:23.195+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:24.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 msgr2=0x7fa844010040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844008460 0x7fa844010040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 >> v1:172.21.15.133:6789/0 conn(0x7fa844010580 legacy=0x7fa844012970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 reap_dead start 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640c4280 con 0x7fa844014090 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86415db50 con 0x7fa844017cf0 2024-01-19T04:30:24.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844008d40 con 0x7fa844003af0 2024-01-19T04:30:24.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.439+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:24.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.471+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:24.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.483+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:24.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.483+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:24.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.483+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:24.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.483+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:24.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.491+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-19T04:30:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.491+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.491+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.491+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:24.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.687+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:24.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.691+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:24.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.691+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:24.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.691+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:24.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.691+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:24.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.699+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.703+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:24.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.703+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.703+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:24.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:24.703+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:30:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.095+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.095+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.095+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.095+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.095+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.107+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:25.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.115+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:25.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.115+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:25.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.115+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:25.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.115+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:30:25.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.907+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:25.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.911+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:25.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.911+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:25.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.911+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:25.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.911+0000 7fa8637fe640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:25.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.919+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:25.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.923+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:30:25.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.923+0000 7fa85a7fc640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:25.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.923+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:25.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:25.923+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 msgr2=0x7fa84400e6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa844003af0 0x7fa84400e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 msgr2=0x7fa84400e050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.156:3300/0 conn(0x7fa844017cf0 0x7fa84400e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 >> v1:172.21.15.133:6789/0 conn(0x7fa844014090 legacy=0x7fa8440164e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 0x7fa844007990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640c3fa0 con 0x7fa844012970 2024-01-19T04:30:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.375+0000 7fa8617fa640 1 -- 172.21.15.133:0/468692273 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86415db50 con 0x7fa844006fa0 2024-01-19T04:30:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.487+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 0x7fa844007990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.535+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 msgr2=0x7fa844007990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:30:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.535+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 msgr2=0x7fa844007990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:30:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.535+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 0x7fa844007990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:30:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.535+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 0x7fa844007990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:30:27.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.791+0000 7fa8627fc640 1 -- 172.21.15.133:0/468692273 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289007092 0 0) 0x7fa8640c3fa0 con 0x7fa844012970 2024-01-19T04:30:27.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.791+0000 7fa8627fc640 1 -- 172.21.15.133:0/468692273 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa850003530 con 0x7fa844012970 2024-01-19T04:30:27.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.883+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> v2:172.21.15.133:3300/0 conn(0x7fa844006fa0 0x7fa844007990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:27.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.923+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 >> v1:172.21.15.156:6789/0 conn(0x7fa844012970 legacy=0x7fa844012d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:27.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.923+0000 7fa862ffd640 1 -- 172.21.15.133:0/468692273 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440068e0 con 0x7fa844006fa0 2024-01-19T04:30:27.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:27.975+0000 7fa862ffd640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa844006fa0 0x7fa844007990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa854000c10 tx=0x7fa85401cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e040b3256e636fdb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.187+0000 7fa8627fc640 1 -- 172.21.15.133:0/468692273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540a5990 con 0x7fa844006fa0 2024-01-19T04:30:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.187+0000 7fa8627fc640 1 -- 172.21.15.133:0/468692273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540a9070 con 0x7fa844006fa0 2024-01-19T04:30:28.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.187+0000 7fa8627fc640 1 -- 172.21.15.133:0/468692273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540a5db0 con 0x7fa844006fa0 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- 172.21.15.133:0/468692273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa844006fa0 msgr2=0x7fa844007990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa844006fa0 0x7fa844007990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa854000c10 tx=0x7fa85401cd70 comp rx=0 tx=0).stop 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa8637fe640 1 -- 172.21.15.133:0/468692273 reap_dead start 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- 172.21.15.133:0/468692273 shutdown_connections 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 --2- 172.21.15.133:0/468692273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa844006fa0 0x7fa844007990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- 172.21.15.133:0/468692273 >> 172.21.15.133:0/468692273 conn(0x7fa86408b600 msgr2=0x7fa864071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- 172.21.15.133:0/468692273 shutdown_connections 2024-01-19T04:30:28.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- 172.21.15.133:0/468692273 wait complete. 2024-01-19T04:30:28.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 Processor -- start 2024-01-19T04:30:28.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- start start 2024-01-19T04:30:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa864144cb0 0x7fa8641f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 0x7fa86415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa86415a710 0x7fa8641f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8641efbf0 con 0x7fa86415a710 2024-01-19T04:30:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640ce680 con 0x7fa864144cb0 2024-01-19T04:30:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.191+0000 7fa869491640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640ce940 con 0x7fa864145090 2024-01-19T04:30:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.199+0000 7fa85a7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 0x7fa86415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.199+0000 7fa85a7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 0x7fa86415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:46676/0 (socket says 172.21.15.133:46676) 2024-01-19T04:30:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.203+0000 7fa85a7fc640 1 -- 172.21.15.133:0/418506233 learned_addr learned my addr 172.21.15.133:0/418506233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.219+0000 7fa8637fe640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa86415a710 0x7fa8641f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:28.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.227+0000 7fa85a7fc640 1 -- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa864144cb0 msgr2=0x7fa8641f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:28.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.227+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa864144cb0 0x7fa8641f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:28.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.227+0000 7fa85a7fc640 1 -- 172.21.15.133:0/418506233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa86415a710 msgr2=0x7fa8641f0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:28.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.227+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa86415a710 0x7fa8641f0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:28.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.227+0000 7fa85a7fc640 1 -- 172.21.15.133:0/418506233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640c4280 con 0x7fa864145090 2024-01-19T04:30:28.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.235+0000 7fa85a7fc640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 0x7fa86415c760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa844006f20 tx=0x7fa84c00e7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.299+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c013070 con 0x7fa864145090 2024-01-19T04:30:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.299+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c009ed0 con 0x7fa864145090 2024-01-19T04:30:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.299+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8640cec20 con 0x7fa864145090 2024-01-19T04:30:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.299+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c017610 con 0x7fa864145090 2024-01-19T04:30:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.299+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa864145650 con 0x7fa864145090 2024-01-19T04:30:28.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.303+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa864074340 con 0x7fa864145090 2024-01-19T04:30:28.562 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:28.558+0000 7f2a5ef61180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-19T04:30:28.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.571+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa84c017af0 con 0x7fa864145090 2024-01-19T04:30:28.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.591+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa84c00c3e0 con 0x7fa864145090 2024-01-19T04:30:28.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.591+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fa84c026060 con 0x7fa864145090 2024-01-19T04:30:28.673 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:28.667+0000 7ff673a70180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-19T04:30:28.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:28.707+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa8640c5c40 con 0x7fa864145090 2024-01-19T04:30:29.068 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:29.062+0000 7f2a5ef61180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-19T04:30:29.169 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:29.167+0000 7ff673a70180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-19T04:30:29.283 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:29.278+0000 7f2a5ef61180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-19T04:30:29.390 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:29.387+0000 7ff673a70180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-19T04:30:29.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa85bfff640 1 -- 172.21.15.133:0/418506233 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa84c01c070 con 0x7fa864145090 2024-01-19T04:30:29.397 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 msgr2=0x7fa86415c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 0x7fa86415c760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa844006f20 tx=0x7fa84c00e7d0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 shutdown_connections 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa86415a710 0x7fa8641f0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa864145090 0x7fa86415c760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 --2- 172.21.15.133:0/418506233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa864144cb0 0x7fa8641f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 >> 172.21.15.133:0/418506233 conn(0x7fa86408b600 msgr2=0x7fa864148770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 shutdown_connections 2024-01-19T04:30:29.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:29.395+0000 7fa869491640 1 -- 172.21.15.133:0/418506233 wait complete. 2024-01-19T04:30:29.418 INFO:tasks.ceph:check_enable_crimson: False 2024-01-19T04:30:29.418 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-19T04:30:29.418 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:29.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-19T04:30:29.429 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:29.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-19T04:30:29.483 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:29.483 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-19T04:30:29.535 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:30:29.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-19T04:30:29.588 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:29.588 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-19T04:30:29.600 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:29.601 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-19T04:30:29.656 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:29.656 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-19T04:30:29.712 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-01-19T04:30:29.713 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-19T04:30:29.765 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new b0777239-db39-43f3-9d79-68d520aebea5 0 2024-01-19T04:30:29.848 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:29.842+0000 7f2a5ef61180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-19T04:30:29.903 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:29.898+0000 7f2a5ef61180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-19T04:30:29.928 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.922+0000 7fc62d998640 1 Processor -- start 2024-01-19T04:30:29.928 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.922+0000 7fc62d998640 1 -- start start 2024-01-19T04:30:29.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.922+0000 7fc62d998640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6280c2e00 0x7fc6280c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:29.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.922+0000 7fc62d998640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc62806e460 0x7fc62815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:29.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.922+0000 7fc62d998640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc628156a20 con 0x7fc628150500 2024-01-19T04:30:29.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.926+0000 7fc62d998640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc628156d00 con 0x7fc6280c2e00 2024-01-19T04:30:29.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.926+0000 7fc62d998640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc628156fe0 con 0x7fc62806e460 2024-01-19T04:30:29.930 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.926+0000 7fc6277fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc62806e460 0x7fc62815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:29.930 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.926+0000 7fc626ffd640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc628150500 0x7fc628156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40332/0 (socket says 172.21.15.156:40332) 2024-01-19T04:30:29.930 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.926+0000 7fc626ffd640 1 -- 172.21.15.156:0/891149181 learned_addr learned my addr 172.21.15.156:0/891149181 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-01-19T04:30:29.930 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.926+0000 7fc6267fc640 1 --2- 172.21.15.156:0/891149181 >> v2:172.21.15.133:3300/0 conn(0x7fc6280c2e00 0x7fc6280c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:29.935 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.930+0000 7fc6277fe640 1 -- 172.21.15.156:0/891149181 >> v2:172.21.15.133:3300/0 conn(0x7fc6280c2e00 msgr2=0x7fc6280c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:29.935 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.930+0000 7fc6277fe640 1 --2- 172.21.15.156:0/891149181 >> v2:172.21.15.133:3300/0 conn(0x7fc6280c2e00 0x7fc6280c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.936 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.930+0000 7fc6277fe640 1 -- 172.21.15.156:0/891149181 >> v1:172.21.15.156:6789/0 conn(0x7fc628150500 legacy=0x7fc628156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:29.936 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.930+0000 7fc6277fe640 1 -- 172.21.15.156:0/891149181 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6281599e0 con 0x7fc62806e460 2024-01-19T04:30:29.937 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:29.935+0000 7ff673a70180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-19T04:30:29.940 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.934+0000 7fc6277fe640 1 --2- 172.21.15.156:0/891149181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc62806e460 0x7fc62815a1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc62806e3c0 tx=0x7fc61801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aea8ba92d4426b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:29.945 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc625ffb640 1 -- 172.21.15.156:0/891149181 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6180a8950 con 0x7fc62806e460 2024-01-19T04:30:29.945 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc625ffb640 1 -- 172.21.15.156:0/891149181 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6180a8ab0 con 0x7fc62806e460 2024-01-19T04:30:29.945 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc625ffb640 1 -- 172.21.15.156:0/891149181 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6180a8e40 con 0x7fc62806e460 2024-01-19T04:30:29.946 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- 172.21.15.156:0/891149181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc62806e460 msgr2=0x7fc62815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 --2- 172.21.15.156:0/891149181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc62806e460 0x7fc62815a1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc62806e3c0 tx=0x7fc61801ec50 comp rx=0 tx=0).stop 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- 172.21.15.156:0/891149181 shutdown_connections 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 --2- 172.21.15.156:0/891149181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc62806e460 0x7fc62815a1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 --2- 172.21.15.156:0/891149181 >> v2:172.21.15.133:3300/0 conn(0x7fc6280c2e00 0x7fc6280c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- 172.21.15.156:0/891149181 >> 172.21.15.156:0/891149181 conn(0x7fc62806b770 msgr2=0x7fc62806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- 172.21.15.156:0/891149181 shutdown_connections 2024-01-19T04:30:29.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- 172.21.15.156:0/891149181 wait complete. 2024-01-19T04:30:29.948 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 Processor -- start 2024-01-19T04:30:29.948 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- start start 2024-01-19T04:30:29.949 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc62806e460 0x7fc6281ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:29.949 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 0x7fc6281529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:29.949 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc628150500 0x7fc6281554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:29.949 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc628151260 con 0x7fc628150500 2024-01-19T04:30:29.949 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6281eec00 con 0x7fc6280c2e00 2024-01-19T04:30:29.949 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.942+0000 7fc62d998640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc628150ca0 con 0x7fc62806e460 2024-01-19T04:30:29.950 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.946+0000 7fc6267fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 0x7fc6281529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:29.950 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.946+0000 7fc626ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc62806e460 0x7fc6281ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:29.950 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.946+0000 7fc6267fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 0x7fc6281529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35990/0 (socket says 172.21.15.156:35990) 2024-01-19T04:30:29.950 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.946+0000 7fc6267fc640 1 -- 172.21.15.156:0/2647626334 learned_addr learned my addr 172.21.15.156:0/2647626334 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:29.951 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.946+0000 7fc6277fe640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc628150500 0x7fc6281554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:29.953 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.950+0000 7fc6267fc640 1 -- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc62806e460 msgr2=0x7fc6281ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.950+0000 7fc6267fc640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc62806e460 0x7fc6281ee6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.950+0000 7fc6267fc640 1 -- 172.21.15.156:0/2647626334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc628150500 msgr2=0x7fc6281554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.950+0000 7fc6267fc640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc628150500 0x7fc6281554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.950+0000 7fc6267fc640 1 -- 172.21.15.156:0/2647626334 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618009420 con 0x7fc6280c2e00 2024-01-19T04:30:29.956 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.950+0000 7fc6267fc640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 0x7fc6281529e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00e930 tx=0x7fc61c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:29.959 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:29.954+0000 7f2a5ef61180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-19T04:30:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.954+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c009690 con 0x7fc6280c2e00 2024-01-19T04:30:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.954+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00ca00 con 0x7fc6280c2e00 2024-01-19T04:30:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.954+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc628150f80 con 0x7fc6280c2e00 2024-01-19T04:30:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.954+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00cd70 con 0x7fc6280c2e00 2024-01-19T04:30:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.954+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6281539b0 con 0x7fc6280c2e00 2024-01-19T04:30:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.954+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc628153530 con 0x7fc6280c2e00 2024-01-19T04:30:29.967 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:29.962+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fc61c0059a0 con 0x7fc6280c2e00 2024-01-19T04:30:29.992 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:29.987+0000 7ff673a70180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-19T04:30:30.039 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:30.034+0000 7f2a5ef61180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-19T04:30:30.044 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.039+0000 7ff673a70180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-19T04:30:30.092 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:30.086+0000 7f2a5ef61180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-19T04:30:30.121 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.119+0000 7ff673a70180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-19T04:30:30.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.162+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc61c013890 con 0x7fc6280c2e00 2024-01-19T04:30:30.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.162+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fc628153530 con 0x7fc6280c2e00 2024-01-19T04:30:30.170 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:30.166+0000 7f2a5ef61180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-19T04:30:30.173 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.167+0000 7ff673a70180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-19T04:30:30.223 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:30.218+0000 7f2a5ef61180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-19T04:30:30.251 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.247+0000 7ff673a70180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-19T04:30:30.255 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.250+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0777239-db39-43f3-9d79-68d520aebea5", "id": 0} v 0) v1 -- 0x7fc628153ba0 con 0x7fc6280c2e00 2024-01-19T04:30:30.304 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.299+0000 7ff673a70180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-19T04:30:30.367 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:30.362+0000 7f2a5ef61180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-19T04:30:30.426 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:30.422+0000 7f2a5ef61180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-19T04:30:30.444 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.439+0000 7ff673a70180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-19T04:30:30.506 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:30.503+0000 7ff673a70180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-19T04:30:30.629 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc60ffff640 1 -- 172.21.15.156:0/2647626334 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0777239-db39-43f3-9d79-68d520aebea5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc61c021060 con 0x7fc6280c2e00 2024-01-19T04:30:30.630 INFO:teuthology.orchestra.run.smithi156.stdout:0 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 msgr2=0x7fc6281529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 0x7fc6281529e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00e930 tx=0x7fc61c00edf0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 shutdown_connections 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6280c2e00 0x7fc6281529e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc628150500 0x7fc6281554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 --2- 172.21.15.156:0/2647626334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc62806e460 0x7fc6281ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 >> 172.21.15.156:0/2647626334 conn(0x7fc62806b770 msgr2=0x7fc6280c51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:30.632 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 shutdown_connections 2024-01-19T04:30:30.633 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.626+0000 7fc62d998640 1 -- 172.21.15.156:0/2647626334 wait complete. 2024-01-19T04:30:30.649 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 1f203406-a6f3-4ab9-81bf-4af5da0c0ca0 1 2024-01-19T04:30:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e9fd7640 1 Processor -- start 2024-01-19T04:30:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e9fd7640 1 -- start start 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e9fd7640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7e406bb90 0x7fa7e40c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e9fd7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e4066b10 con 0x7fa7e40c5030 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e9fd7640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e406aee0 con 0x7fa7e4151390 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e9fd7640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e40c7560 con 0x7fa7e406bb90 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.846+0000 7fa7e2ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7e406bb90 0x7fa7e40c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.850+0000 7fa7e37fe640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa7e4151390 0x7fa7e4157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40334/0 (socket says 172.21.15.156:40334) 2024-01-19T04:30:30.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.850+0000 7fa7e37fe640 1 -- 172.21.15.156:0/2270703475 learned_addr learned my addr 172.21.15.156:0/2270703475 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-01-19T04:30:30.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.854+0000 7fa7e2ffd640 1 -- 172.21.15.156:0/2270703475 >> v1:172.21.15.156:6789/0 conn(0x7fa7e4151390 legacy=0x7fa7e4157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:30.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.854+0000 7fa7e2ffd640 1 -- 172.21.15.156:0/2270703475 >> v1:172.21.15.133:6789/0 conn(0x7fa7e40c5030 legacy=0x7fa7e415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:30.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.854+0000 7fa7e2ffd640 1 -- 172.21.15.156:0/2270703475 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4066590 con 0x7fa7e406bb90 2024-01-19T04:30:30.861 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.858+0000 7fa7e2ffd640 1 --2- 172.21.15.156:0/2270703475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e406bb90 0x7fa7e40c4af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009d90 tx=0x7fa7d401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53e16ae899362d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:30.865 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.858+0000 7fa7e27fc640 1 -- 172.21.15.156:0/2270703475 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40a5890 con 0x7fa7e406bb90 2024-01-19T04:30:30.865 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.858+0000 7fa7e27fc640 1 -- 172.21.15.156:0/2270703475 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d40a59f0 con 0x7fa7e406bb90 2024-01-19T04:30:30.865 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.858+0000 7fa7e27fc640 1 -- 172.21.15.156:0/2270703475 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40a5d80 con 0x7fa7e406bb90 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/2270703475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e406bb90 msgr2=0x7fa7e40c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 --2- 172.21.15.156:0/2270703475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e406bb90 0x7fa7e40c4af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009d90 tx=0x7fa7d401c8c0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/2270703475 shutdown_connections 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 --2- 172.21.15.156:0/2270703475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e406bb90 0x7fa7e40c4af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/2270703475 >> 172.21.15.156:0/2270703475 conn(0x7fa7e40cb3e0 msgr2=0x7fa7e40cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/2270703475 shutdown_connections 2024-01-19T04:30:30.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/2270703475 wait complete. 2024-01-19T04:30:30.867 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 Processor -- start 2024-01-19T04:30:30.867 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- start start 2024-01-19T04:30:30.867 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 0x7fa7e414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:30.868 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e40c5030 0x7fa7e413db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:30.868 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e4151390 0x7fa7e414caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:30.868 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40cb0a0 con 0x7fa7e4151390 2024-01-19T04:30:30.868 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40ca520 con 0x7fa7e40c5030 2024-01-19T04:30:30.868 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e9fd7640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e414e920 con 0x7fa7e406bb90 2024-01-19T04:30:30.869 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e37fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 0x7fa7e414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:30.869 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e37fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 0x7fa7e414ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46194/0 (socket says 172.21.15.156:46194) 2024-01-19T04:30:30.869 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e37fe640 1 -- 172.21.15.156:0/3323272448 learned_addr learned my addr 172.21.15.156:0/3323272448 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:30.869 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.862+0000 7fa7e2ffd640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e40c5030 0x7fa7e413db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:30.870 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.866+0000 7fa7e3fff640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e4151390 0x7fa7e414caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:30.873 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.870+0000 7fa7e37fe640 1 -- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e40c5030 msgr2=0x7fa7e413db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:30.874 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.870+0000 7fa7e37fe640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e40c5030 0x7fa7e413db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.874 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.870+0000 7fa7e37fe640 1 -- 172.21.15.156:0/3323272448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e4151390 msgr2=0x7fa7e414caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:30.874 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.870+0000 7fa7e37fe640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e4151390 0x7fa7e414caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:30.874 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.870+0000 7fa7e37fe640 1 -- 172.21.15.156:0/3323272448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d4009a70 con 0x7fa7e406bb90 2024-01-19T04:30:30.876 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.870+0000 7fa7e37fe640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 0x7fa7e414ec30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c430 tx=0x7fa7d800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:30.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.874+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8005cf0 con 0x7fa7e406bb90 2024-01-19T04:30:30.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.874+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8005e50 con 0x7fa7e406bb90 2024-01-19T04:30:30.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.878+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e413f660 con 0x7fa7e406bb90 2024-01-19T04:30:30.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.878+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80072d0 con 0x7fa7e406bb90 2024-01-19T04:30:30.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.878+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e40c9bf0 con 0x7fa7e406bb90 2024-01-19T04:30:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.878+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e4074340 con 0x7fa7e406bb90 2024-01-19T04:30:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.878+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa7d801c440 con 0x7fa7e406bb90 2024-01-19T04:30:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.878+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa7d8012b20 con 0x7fa7e406bb90 2024-01-19T04:30:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:30.986+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fa7d8021060 con 0x7fa7e406bb90 2024-01-19T04:30:31.074 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.070+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1f203406-a6f3-4ab9-81bf-4af5da0c0ca0", "id": 1} v 0) v1 -- 0x7fa7e41571c0 con 0x7fa7e406bb90 2024-01-19T04:30:31.077 INFO:tasks.ceph.mgr.x.smithi156.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-19T04:30:31.077 INFO:tasks.ceph.mgr.x.smithi156.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-19T04:30:31.078 INFO:tasks.ceph.mgr.x.smithi156.stderr: from numpy import show_config as show_numpy_config 2024-01-19T04:30:31.120 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:31.114+0000 7f2a5ef61180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-19T04:30:31.190 INFO:tasks.ceph.mgr.y.smithi133.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-19T04:30:31.191 INFO:tasks.ceph.mgr.y.smithi133.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-19T04:30:31.191 INFO:tasks.ceph.mgr.y.smithi133.stderr: from numpy import show_config as show_numpy_config 2024-01-19T04:30:31.258 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:31.254+0000 7f2a5ef61180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:30:31.262 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7cbfff640 1 -- 172.21.15.156:0/3323272448 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f203406-a6f3-4ab9-81bf-4af5da0c0ca0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7d8017070 con 0x7fa7e406bb90 2024-01-19T04:30:31.263 INFO:teuthology.orchestra.run.smithi156.stdout:1 2024-01-19T04:30:31.263 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:31.259+0000 7ff673a70180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 msgr2=0x7fa7e414ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 0x7fa7e414ec30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c430 tx=0x7fa7d800c8f0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 shutdown_connections 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e40c5030 0x7fa7e413db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e4151390 0x7fa7e414caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 --2- 172.21.15.156:0/3323272448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e406bb90 0x7fa7e414ec30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 >> 172.21.15.156:0/3323272448 conn(0x7fa7e40cb3e0 msgr2=0x7fa7e413c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:31.265 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 shutdown_connections 2024-01-19T04:30:31.266 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.258+0000 7fa7e9fd7640 1 -- 172.21.15.156:0/3323272448 wait complete. 2024-01-19T04:30:31.289 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new c4baddb0-79b2-47ca-9fce-962d2298dd6f 2 2024-01-19T04:30:31.424 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:31.418+0000 7f2a5ef61180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-19T04:30:31.428 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 Processor -- start 2024-01-19T04:30:31.428 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 -- start start 2024-01-19T04:30:31.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 0x7feaf80c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:31.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feaf80c7620 0x7feaf81507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:31.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf80c5220 con 0x7feaf80c6570 2024-01-19T04:30:31.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80c5a50 con 0x7feaf80c7620 2024-01-19T04:30:31.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.422+0000 7feafd60f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8157260 con 0x7feaf80c6190 2024-01-19T04:30:31.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf77fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feaf80c7620 0x7feaf81507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:31.430 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 0x7feaf80c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:31.430 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 0x7feaf80c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46208/0 (socket says 172.21.15.156:46208) 2024-01-19T04:30:31.430 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 -- 172.21.15.156:0/1658681762 learned_addr learned my addr 172.21.15.156:0/1658681762 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:31.432 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 -- 172.21.15.156:0/1658681762 >> v2:172.21.15.156:3300/0 conn(0x7feaf80c7620 msgr2=0x7feaf81507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:31.432 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 --2- 172.21.15.156:0/1658681762 >> v2:172.21.15.156:3300/0 conn(0x7feaf80c7620 0x7feaf81507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.432 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 -- 172.21.15.156:0/1658681762 >> v1:172.21.15.156:6789/0 conn(0x7feaf80c6570 legacy=0x7feaf8150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:31.433 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.426+0000 7feaf6ffd640 1 -- 172.21.15.156:0/1658681762 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80c5490 con 0x7feaf80c6190 2024-01-19T04:30:31.435 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.430+0000 7feaf6ffd640 1 --2- 172.21.15.156:0/1658681762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 0x7feaf80c3060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feae800bb10 tx=0x7feae801eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ad12288255b1ce server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:31.440 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:31.435+0000 7ff673a70180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.434+0000 7feaf5ffb640 1 -- 172.21.15.156:0/1658681762 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80a7b20 con 0x7feaf80c6190 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.434+0000 7feaf5ffb640 1 -- 172.21.15.156:0/1658681762 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80a7c80 con 0x7feaf80c6190 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.434+0000 7feaf5ffb640 1 -- 172.21.15.156:0/1658681762 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80af440 con 0x7feaf80c6190 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.434+0000 7feafd60f640 1 -- 172.21.15.156:0/1658681762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 msgr2=0x7feaf80c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.434+0000 7feafd60f640 1 --2- 172.21.15.156:0/1658681762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 0x7feaf80c3060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feae800bb10 tx=0x7feae801eb50 comp rx=0 tx=0).stop 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- 172.21.15.156:0/1658681762 shutdown_connections 2024-01-19T04:30:31.445 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 --2- 172.21.15.156:0/1658681762 >> v2:172.21.15.156:3300/0 conn(0x7feaf80c7620 0x7feaf81507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 --2- 172.21.15.156:0/1658681762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6190 0x7feaf80c3060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- 172.21.15.156:0/1658681762 >> 172.21.15.156:0/1658681762 conn(0x7feaf806fa20 msgr2=0x7feaf80c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- 172.21.15.156:0/1658681762 shutdown_connections 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- 172.21.15.156:0/1658681762 wait complete. 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 Processor -- start 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- start start 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf80c6190 0x7feaf81f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6570 0x7feaf8152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 0x7feaf8141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81eea20 con 0x7feaf80c6190 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81f2430 con 0x7feaf80c7620 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feafd60f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81465c0 con 0x7feaf80c6570 2024-01-19T04:30:31.446 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feaf67fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6570 0x7feaf8152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:31.447 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 0x7feaf8141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:31.447 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 0x7feaf8141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36018/0 (socket says 172.21.15.156:36018) 2024-01-19T04:30:31.447 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feaf77fe640 1 -- 172.21.15.156:0/1372203834 learned_addr learned my addr 172.21.15.156:0/1372203834 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:31.447 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.438+0000 7feaf6ffd640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf80c6190 0x7feaf81f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:31.448 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.442+0000 7feaf77fe640 1 -- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6570 msgr2=0x7feaf8152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:31.448 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.442+0000 7feaf77fe640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6570 0x7feaf8152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.448 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.442+0000 7feaf77fe640 1 -- 172.21.15.156:0/1372203834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf80c6190 msgr2=0x7feaf81f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:31.448 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.442+0000 7feaf77fe640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf80c6190 0x7feaf81f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.448 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.442+0000 7feaf77fe640 1 -- 172.21.15.156:0/1372203834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae800b770 con 0x7feaf80c7620 2024-01-19T04:30:31.449 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.446+0000 7feaf77fe640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 0x7feaf8141030 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feaf000efc0 tx=0x7feaf000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:31.453 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.450+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0009ca0 con 0x7feaf80c7620 2024-01-19T04:30:31.454 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.450+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf000f040 con 0x7feaf80c7620 2024-01-19T04:30:31.454 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.450+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00146c0 con 0x7feaf80c7620 2024-01-19T04:30:31.454 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.450+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf8146af0 con 0x7feaf80c7620 2024-01-19T04:30:31.454 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.450+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf8146810 con 0x7feaf80c7620 2024-01-19T04:30:31.454 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.450+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8066c70 con 0x7feaf80c7620 2024-01-19T04:30:31.457 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.454+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7feaf0014820 con 0x7feaf80c7620 2024-01-19T04:30:31.457 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.454+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7feaf001d820 con 0x7feaf80c7620 2024-01-19T04:30:31.497 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:31.490+0000 7f2a5ef61180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-19T04:30:31.576 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.570+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7feaf003ccf0 con 0x7feaf80c7620 2024-01-19T04:30:31.614 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:31.611+0000 7ff673a70180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-19T04:30:31.633 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:31.626+0000 7f2a5ef61180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:30:31.654 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.650+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4baddb0-79b2-47ca-9fce-962d2298dd6f", "id": 2} v 0) v1 -- 0x7feaf81eeb60 con 0x7feaf80c7620 2024-01-19T04:30:31.693 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:31.691+0000 7ff673a70180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-19T04:30:31.835 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:31.831+0000 7ff673a70180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:30:31.888 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.882+0000 7feadf7fe640 1 -- 172.21.15.156:0/1372203834 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4baddb0-79b2-47ca-9fce-962d2298dd6f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7feaf81eeb60 con 0x7feaf80c7620 2024-01-19T04:30:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:2 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 msgr2=0x7feaf8141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 0x7feaf8141030 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feaf000efc0 tx=0x7feaf000c490 comp rx=0 tx=0).stop 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 shutdown_connections 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaf80c7620 0x7feaf8141030 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaf80c6570 0x7feaf8152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 --2- 172.21.15.156:0/1372203834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf80c6190 0x7feaf81f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 >> 172.21.15.156:0/1372203834 conn(0x7feaf806fa20 msgr2=0x7feaf814e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 shutdown_connections 2024-01-19T04:30:31.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:31.886+0000 7feafd60f640 1 -- 172.21.15.156:0/1372203834 wait complete. 2024-01-19T04:30:31.908 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d 3 2024-01-19T04:30:32.025 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.018+0000 7f66dee17640 1 Processor -- start 2024-01-19T04:30:32.025 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.018+0000 7f66dee17640 1 -- start start 2024-01-19T04:30:32.026 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66dee17640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66d8150500 0x7f66d80c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.026 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66dee17640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d8156a20 con 0x7f66d806e460 2024-01-19T04:30:32.026 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66dee17640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d8156d00 con 0x7f66d80c2e00 2024-01-19T04:30:32.026 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66dee17640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d8156fe0 con 0x7f66d8150500 2024-01-19T04:30:32.026 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66d7fff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f66d80c2e00 0x7f66d8156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40346/0 (socket says 172.21.15.156:40346) 2024-01-19T04:30:32.026 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66d7fff640 1 -- 172.21.15.156:0/3548683356 learned_addr learned my addr 172.21.15.156:0/3548683356 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-01-19T04:30:32.027 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.022+0000 7f66dcbb3640 1 --2- 172.21.15.156:0/3548683356 >> v2:172.21.15.133:3300/0 conn(0x7f66d8150500 0x7f66d80c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.029 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.026+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575009288 0 0) 0x7f66d8156d00 con 0x7f66d80c2e00 2024-01-19T04:30:32.029 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.026+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c4003530 con 0x7f66d80c2e00 2024-01-19T04:30:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1666540043 0 0) 0x7f66c4003530 con 0x7f66d80c2e00 2024-01-19T04:30:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 >> v2:172.21.15.133:3300/0 conn(0x7f66d8150500 msgr2=0x7f66d80c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 --2- 172.21.15.156:0/3548683356 >> v2:172.21.15.133:3300/0 conn(0x7f66d8150500 0x7f66d80c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 >> v1:172.21.15.133:6789/0 conn(0x7f66d806e460 legacy=0x7f66d815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d81599e0 con 0x7f66d80c2e00 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f66c0001680 con 0x7f66d80c2e00 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 >> v1:172.21.15.156:6789/0 conn(0x7f66d80c2e00 legacy=0x7f66d8156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4003a40 0x7f66c4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66c40047d0 0x7f66c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40051e0 0x7f66c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d8156fe0 con 0x7f66c4003a40 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c400c0f0 con 0x7f66c40051e0 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c400c2b0 con 0x7f66c40047d0 2024-01-19T04:30:32.037 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.030+0000 7f66d7fff640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66c40047d0 0x7f66c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66d7fff640 1 -- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40051e0 msgr2=0x7f66c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66dd3b4640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40051e0 0x7f66c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66d7fff640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40051e0 0x7f66c400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66d7fff640 1 -- 172.21.15.156:0/3548683356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4003a40 msgr2=0x7f66c4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66d7fff640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4003a40 0x7f66c4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66dd3b4640 1 -- 172.21.15.156:0/3548683356 reap_dead start 2024-01-19T04:30:32.039 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.034+0000 7f66d7fff640 1 -- 172.21.15.156:0/3548683356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4003530 con 0x7f66c40047d0 2024-01-19T04:30:32.042 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.038+0000 7f66d7fff640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66c40047d0 0x7f66c4004c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66c000c110 tx=0x7f66c001f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5468f1581a12a71 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:32.046 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00058e0 con 0x7f66c40047d0 2024-01-19T04:30:32.046 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0005a60 con 0x7f66c40047d0 2024-01-19T04:30:32.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66d77fe640 1 -- 172.21.15.156:0/3548683356 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0005e10 con 0x7f66c40047d0 2024-01-19T04:30:32.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 -- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66c40047d0 msgr2=0x7f66c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.047 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66c40047d0 0x7f66c4004c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66c000c110 tx=0x7f66c001f2b0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 -- 172.21.15.156:0/3548683356 shutdown_connections 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 --2- 172.21.15.156:0/3548683356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66c40047d0 0x7f66c4004c50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 -- 172.21.15.156:0/3548683356 >> 172.21.15.156:0/3548683356 conn(0x7f66d806b770 msgr2=0x7f66d806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 -- 172.21.15.156:0/3548683356 shutdown_connections 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 -- 172.21.15.156:0/3548683356 wait complete. 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 Processor -- start 2024-01-19T04:30:32.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.042+0000 7f66dee17640 1 -- start start 2024-01-19T04:30:32.049 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dee17640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40047d0 0x7f66d80c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.049 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dee17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66d8151cf0 0x7f66d8155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.049 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dee17640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 0x7f66d8155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.050 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dee17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81f0100 con 0x7f66d8151cf0 2024-01-19T04:30:32.050 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dee17640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81f0c80 con 0x7f66c40047d0 2024-01-19T04:30:32.050 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dee17640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80c5260 con 0x7f66d806a660 2024-01-19T04:30:32.050 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dd3b4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 0x7f66d8155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.050 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dcbb3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40047d0 0x7f66d80c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.050 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dd3b4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 0x7f66d8155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46238/0 (socket says 172.21.15.156:46238) 2024-01-19T04:30:32.051 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.046+0000 7f66dd3b4640 1 -- 172.21.15.156:0/1049790181 learned_addr learned my addr 172.21.15.156:0/1049790181 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dd3b4640 1 -- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40047d0 msgr2=0x7f66d80c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dd3b4640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40047d0 0x7f66d80c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dd3b4640 1 -- 172.21.15.156:0/1049790181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66d8151cf0 msgr2=0x7f66d8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dd3b4640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66d8151cf0 0x7f66d8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dd3b4640 1 -- 172.21.15.156:0/1049790181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d80c5500 con 0x7f66d806a660 2024-01-19T04:30:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dcbb3640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40047d0 0x7f66d80c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:30:32.056 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.050+0000 7f66dd3b4640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 0x7f66d8155780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f66d80b1b30 tx=0x7f66d000d7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.054+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000b070 con 0x7f66d806a660 2024-01-19T04:30:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.054+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d00054e0 con 0x7f66d806a660 2024-01-19T04:30:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.054+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d81f0350 con 0x7f66d806a660 2024-01-19T04:30:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.054+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0003840 con 0x7f66d806a660 2024-01-19T04:30:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.054+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d81f0910 con 0x7f66d806a660 2024-01-19T04:30:32.061 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.054+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8074340 con 0x7f66d806a660 2024-01-19T04:30:32.062 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.058+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f66d0003d20 con 0x7f66d806a660 2024-01-19T04:30:32.063 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.058+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f66d0013900 con 0x7f66d806a660 2024-01-19T04:30:32.176 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.170+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f66d0018070 con 0x7f66d806a660 2024-01-19T04:30:32.254 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.250+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d", "id": 3} v 0) v1 -- 0x7f66d8070890 con 0x7f66d806a660 2024-01-19T04:30:32.281 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:32.274+0000 7f2a5ef61180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-19T04:30:32.365 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:32.362+0000 7f2a5ef61180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-19T04:30:32.403 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.398+0000 7f66d57fa640 1 -- 172.21.15.156:0/1049790181 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66d0013c30 con 0x7f66d806a660 2024-01-19T04:30:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:3 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 msgr2=0x7f66d8155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 0x7f66d8155780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f66d80b1b30 tx=0x7f66d000d7d0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 shutdown_connections 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66d806a660 0x7f66d8155780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66d8151cf0 0x7f66d8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 --2- 172.21.15.156:0/1049790181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c40047d0 0x7f66d80c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 >> 172.21.15.156:0/1049790181 conn(0x7f66d806b770 msgr2=0x7f66d80c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 shutdown_connections 2024-01-19T04:30:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.402+0000 7f66dee17640 1 -- 172.21.15.156:0/1049790181 wait complete. 2024-01-19T04:30:32.427 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new de82b90b-98c5-4123-a7f9-7d16ea185376 4 2024-01-19T04:30:32.470 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:32.467+0000 7ff673a70180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-19T04:30:32.544 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 Processor -- start 2024-01-19T04:30:32.544 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 -- start start 2024-01-19T04:30:32.544 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f862c0c2e00 0x7f862c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.544 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f862c06e460 0x7f862c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.544 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862c156a20 con 0x7f862c150500 2024-01-19T04:30:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c156d00 con 0x7f862c06e460 2024-01-19T04:30:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8630d7a640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c156fe0 con 0x7f862c0c2e00 2024-01-19T04:30:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.538+0000 7f8629d9b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f862c0c2e00 0x7f862c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.542+0000 7f862a59c640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f862c150500 0x7f862c156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40348/0 (socket says 172.21.15.156:40348) 2024-01-19T04:30:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.542+0000 7f862a59c640 1 -- 172.21.15.156:0/2417627028 learned_addr learned my addr 172.21.15.156:0/2417627028 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-01-19T04:30:32.548 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:32.543+0000 7ff673a70180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-19T04:30:32.550 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.546+0000 7f8629d9b640 1 -- 172.21.15.156:0/2417627028 >> v2:172.21.15.133:3300/0 conn(0x7f862c06e460 msgr2=0x7f862c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:32.550 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.546+0000 7f8629d9b640 1 --2- 172.21.15.156:0/2417627028 >> v2:172.21.15.133:3300/0 conn(0x7f862c06e460 0x7f862c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.550 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.546+0000 7f8629d9b640 1 -- 172.21.15.156:0/2417627028 >> v1:172.21.15.156:6789/0 conn(0x7f862c150500 legacy=0x7f862c156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.550 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.546+0000 7f8629d9b640 1 -- 172.21.15.156:0/2417627028 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c1599e0 con 0x7f862c0c2e00 2024-01-19T04:30:32.554 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.550+0000 7f8629d9b640 1 --2- 172.21.15.156:0/2417627028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c0c2e00 0x7f862c0c5f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f862c0c3240 tx=0x7f8620020e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0440b8225918b29 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:32.558 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f862959a640 1 -- 172.21.15.156:0/2417627028 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200aab60 con 0x7f862c0c2e00 2024-01-19T04:30:32.558 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f862959a640 1 -- 172.21.15.156:0/2417627028 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86200aacc0 con 0x7f862c0c2e00 2024-01-19T04:30:32.558 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f862959a640 1 -- 172.21.15.156:0/2417627028 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200b2660 con 0x7f862c0c2e00 2024-01-19T04:30:32.559 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 -- 172.21.15.156:0/2417627028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c0c2e00 msgr2=0x7f862c0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 --2- 172.21.15.156:0/2417627028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c0c2e00 0x7f862c0c5f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f862c0c3240 tx=0x7f8620020e60 comp rx=0 tx=0).stop 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 -- 172.21.15.156:0/2417627028 shutdown_connections 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 --2- 172.21.15.156:0/2417627028 >> v2:172.21.15.133:3300/0 conn(0x7f862c06e460 0x7f862c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 --2- 172.21.15.156:0/2417627028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c0c2e00 0x7f862c0c5f20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 -- 172.21.15.156:0/2417627028 >> 172.21.15.156:0/2417627028 conn(0x7f862c06b770 msgr2=0x7f862c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 -- 172.21.15.156:0/2417627028 shutdown_connections 2024-01-19T04:30:32.560 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 -- 172.21.15.156:0/2417627028 wait complete. 2024-01-19T04:30:32.561 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 Processor -- start 2024-01-19T04:30:32.561 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.554+0000 7f8630d7a640 1 -- start start 2024-01-19T04:30:32.562 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f8630d7a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 0x7f862c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.562 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f8630d7a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f862c0c2e00 0x7f862c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.562 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f8630d7a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862c150500 0x7f862c1dfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:32.562 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f8630d7a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0c50e0 con 0x7f862c150500 2024-01-19T04:30:32.562 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f8630d7a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0c3280 con 0x7f862c06e460 2024-01-19T04:30:32.562 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f8630d7a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1eb590 con 0x7f862c0c2e00 2024-01-19T04:30:32.563 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f862a59c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 0x7f862c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.563 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f862a59c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 0x7f862c0c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36046/0 (socket says 172.21.15.156:36046) 2024-01-19T04:30:32.563 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.558+0000 7f862a59c640 1 -- 172.21.15.156:0/1993186892 learned_addr learned my addr 172.21.15.156:0/1993186892 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:32.566 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f8629d9b640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f862c0c2e00 0x7f862c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:32.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f862a59c640 1 -- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f862c0c2e00 msgr2=0x7f862c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f862a59c640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f862c0c2e00 0x7f862c158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f862a59c640 1 -- 172.21.15.156:0/1993186892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862c150500 msgr2=0x7f862c1dfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f862a59c640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862c150500 0x7f862c1dfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f862a59c640 1 -- 172.21.15.156:0/1993186892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009420 con 0x7f862c06e460 2024-01-19T04:30:32.569 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.562+0000 7f862a59c640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 0x7f862c0c4ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c370 tx=0x7f861c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:32.575 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.570+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c005cf0 con 0x7f862c06e460 2024-01-19T04:30:32.575 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.570+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c005e50 con 0x7f862c06e460 2024-01-19T04:30:32.575 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.570+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c0c5380 con 0x7f862c06e460 2024-01-19T04:30:32.575 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.570+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0072f0 con 0x7f862c06e460 2024-01-19T04:30:32.575 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.570+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c1593a0 con 0x7f862c06e460 2024-01-19T04:30:32.575 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.570+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c074340 con 0x7f862c06e460 2024-01-19T04:30:32.579 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:32.574+0000 7f2a5ef61180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-19T04:30:32.653 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:32.646+0000 7f2a5ef61180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-19T04:30:32.698 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.694+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f861c01c440 con 0x7f862c06e460 2024-01-19T04:30:32.698 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.694+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f861c01b8c0 con 0x7f862c06e460 2024-01-19T04:30:32.698 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.694+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f861c017070 con 0x7f862c06e460 2024-01-19T04:30:32.724 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:32.719+0000 7ff673a70180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-19T04:30:32.793 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.790+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de82b90b-98c5-4123-a7f9-7d16ea185376", "id": 4} v 0) v1 -- 0x7f862c0c33f0 con 0x7f862c06e460 2024-01-19T04:30:32.798 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:32.795+0000 7ff673a70180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-19T04:30:32.962 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f861affd640 1 -- 172.21.15.156:0/1993186892 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de82b90b-98c5-4123-a7f9-7d16ea185376", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f861c01bbf0 con 0x7f862c06e460 2024-01-19T04:30:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:4 2024-01-19T04:30:32.964 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 msgr2=0x7f862c0c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:32.964 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 0x7f862c0c4ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c370 tx=0x7f861c00c830 comp rx=0 tx=0).stop 2024-01-19T04:30:32.964 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 shutdown_connections 2024-01-19T04:30:32.964 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862c150500 0x7f862c1dfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.965 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f862c0c2e00 0x7f862c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.965 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 --2- 172.21.15.156:0/1993186892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f862c06e460 0x7f862c0c4ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:32.965 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 >> 172.21.15.156:0/1993186892 conn(0x7f862c06b770 msgr2=0x7f862c073ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:32.965 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 shutdown_connections 2024-01-19T04:30:32.965 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:32.958+0000 7f8630d7a640 1 -- 172.21.15.156:0/1993186892 wait complete. 2024-01-19T04:30:32.980 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 804e44dc-27a7-406a-a493-9fabc752b3a2 5 2024-01-19T04:30:32.986 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:32.982+0000 7f2a5ef61180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-19T04:30:33.049 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:33.046+0000 7f2a5ef61180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-19T04:30:33.089 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:33.086+0000 7ff673a70180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-19T04:30:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 Processor -- start 2024-01-19T04:30:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 -- start start 2024-01-19T04:30:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b980c4ea0 0x7f7b9806a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 0x7f7b9815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b980c5280 0x7f7b9815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b980c8ea0 con 0x7f7b980c4ea0 2024-01-19T04:30:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9806bd40 con 0x7f7b980c5280 2024-01-19T04:30:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.090+0000 7f7b9d5a9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c88e0 con 0x7f7b9806b8b0 2024-01-19T04:30:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 0x7f7b9815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b977fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b980c5280 0x7f7b9815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 0x7f7b9815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46264/0 (socket says 172.21.15.156:46264) 2024-01-19T04:30:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 -- 172.21.15.156:0/1798365884 learned_addr learned my addr 172.21.15.156:0/1798365884 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 -- 172.21.15.156:0/1798365884 >> v2:172.21.15.156:3300/0 conn(0x7f7b980c5280 msgr2=0x7f7b9815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 --2- 172.21.15.156:0/1798365884 >> v2:172.21.15.156:3300/0 conn(0x7f7b980c5280 0x7f7b9815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 -- 172.21.15.156:0/1798365884 >> v2:172.21.15.133:3300/0 conn(0x7f7b980c4ea0 msgr2=0x7f7b9806a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 --2- 172.21.15.156:0/1798365884 >> v2:172.21.15.133:3300/0 conn(0x7f7b980c4ea0 0x7f7b9806a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.094+0000 7f7b967fc640 1 -- 172.21.15.156:0/1798365884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980c8bc0 con 0x7f7b9806b8b0 2024-01-19T04:30:33.104 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.098+0000 7f7b967fc640 1 --2- 172.21.15.156:0/1798365884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 0x7f7b9815b1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b9806b3e0 tx=0x7f7b8c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b60a8cba052f5c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.102+0000 7f7b95ffb640 1 -- 172.21.15.156:0/1798365884 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0ab670 con 0x7f7b9806b8b0 2024-01-19T04:30:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.102+0000 7f7b95ffb640 1 -- 172.21.15.156:0/1798365884 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0ab7d0 con 0x7f7b9806b8b0 2024-01-19T04:30:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.102+0000 7f7b95ffb640 1 -- 172.21.15.156:0/1798365884 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0abb60 con 0x7f7b9806b8b0 2024-01-19T04:30:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1798365884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 msgr2=0x7f7b9815b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1798365884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 0x7f7b9815b1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b9806b3e0 tx=0x7f7b8c01c4d0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1798365884 shutdown_connections 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1798365884 >> v2:172.21.15.156:3300/0 conn(0x7f7b980c5280 0x7f7b9815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1798365884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b9806b8b0 0x7f7b9815b1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1798365884 >> v2:172.21.15.133:3300/0 conn(0x7f7b980c4ea0 0x7f7b9806a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1798365884 >> 172.21.15.156:0/1798365884 conn(0x7f7b9806fa20 msgr2=0x7f7b980c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1798365884 shutdown_connections 2024-01-19T04:30:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1798365884 wait complete. 2024-01-19T04:30:33.111 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 Processor -- start 2024-01-19T04:30:33.111 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- start start 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980c4ea0 0x7f7b981468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 0x7f7b98145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b98146020 0x7f7b9813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981403b0 con 0x7f7b980c4ea0 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98142f80 con 0x7f7b98146020 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b9d5a9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981405a0 con 0x7f7b980c5280 2024-01-19T04:30:33.112 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b967fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 0x7f7b98145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b977fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b98146020 0x7f7b9813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b967fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 0x7f7b98145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46274/0 (socket says 172.21.15.156:46274) 2024-01-19T04:30:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.106+0000 7f7b967fc640 1 -- 172.21.15.156:0/1488560734 learned_addr learned my addr 172.21.15.156:0/1488560734 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.110+0000 7f7b967fc640 1 -- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b98146020 msgr2=0x7f7b9813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.110+0000 7f7b967fc640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b98146020 0x7f7b9813df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.110+0000 7f7b967fc640 1 -- 172.21.15.156:0/1488560734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980c4ea0 msgr2=0x7f7b981468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.110+0000 7f7b967fc640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980c4ea0 0x7f7b981468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.110+0000 7f7b967fc640 1 -- 172.21.15.156:0/1488560734 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0094d0 con 0x7f7b980c5280 2024-01-19T04:30:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.114+0000 7f7b967fc640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 0x7f7b98145ae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0ad040 tx=0x7f7b8c01ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:33.122 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.118+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0b4800 con 0x7f7b980c5280 2024-01-19T04:30:33.122 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.118+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b98142950 con 0x7f7b980c5280 2024-01-19T04:30:33.122 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.118+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b98140840 con 0x7f7b980c5280 2024-01-19T04:30:33.123 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.118+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b98074340 con 0x7f7b980c5280 2024-01-19T04:30:33.123 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.118+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0ab610 con 0x7f7b980c5280 2024-01-19T04:30:33.123 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.118+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c005ba0 con 0x7f7b980c5280 2024-01-19T04:30:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.122+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f7b8c0b4ce0 con 0x7f7b980c5280 2024-01-19T04:30:33.151 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-19T04:30:33.146+0000 7ff673a70180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-19T04:30:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.230+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7b8c006280 con 0x7f7b980c5280 2024-01-19T04:30:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.230+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7b8c0a7070 con 0x7f7b980c5280 2024-01-19T04:30:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.306+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "804e44dc-27a7-406a-a493-9fabc752b3a2", "id": 5} v 0) v1 -- 0x7f7b980c86c0 con 0x7f7b980c5280 2024-01-19T04:30:33.727 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:33.722+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mgrmap(e 2) v1 ==== 42947+0+0 (secure 0 0 0) 0x7f7b8c0064a0 con 0x7f7b980c5280 2024-01-19T04:30:34.553 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b7f7fe640 1 -- 172.21.15.156:0/1488560734 <== mon.2 v2:172.21.15.156:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "804e44dc-27a7-406a-a493-9fabc752b3a2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7b8c0aac50 con 0x7f7b980c5280 2024-01-19T04:30:34.554 INFO:teuthology.orchestra.run.smithi156.stdout:5 2024-01-19T04:30:34.555 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 msgr2=0x7f7b98145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:34.555 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 0x7f7b98145ae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0ad040 tx=0x7f7b8c01ad10 comp rx=0 tx=0).stop 2024-01-19T04:30:34.555 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 shutdown_connections 2024-01-19T04:30:34.555 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b98146020 0x7f7b9813df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:34.555 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b980c5280 0x7f7b98145ae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:34.555 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 --2- 172.21.15.156:0/1488560734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980c4ea0 0x7f7b981468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:34.556 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 >> 172.21.15.156:0/1488560734 conn(0x7f7b9806fa20 msgr2=0x7f7b98072110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:34.556 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 shutdown_connections 2024-01-19T04:30:34.556 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.550+0000 7f7b9d5a9640 1 -- 172.21.15.156:0/1488560734 wait complete. 2024-01-19T04:30:34.577 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 4814caa0-7810-463f-af0c-a608320ede1a 6 2024-01-19T04:30:34.743 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faed128e640 1 Processor -- start 2024-01-19T04:30:34.743 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faed128e640 1 -- start start 2024-01-19T04:30:34.744 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faed128e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc0cf660 0x7faecc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:34.744 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faed128e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc15a2b0 con 0x7faecc0cf280 2024-01-19T04:30:34.744 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faed128e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc15a590 con 0x7faecc15da50 2024-01-19T04:30:34.744 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faed128e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc15d630 con 0x7faecc0cf660 2024-01-19T04:30:34.745 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faecb7fe640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7faecc15da50 0x7faecc159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40354/0 (socket says 172.21.15.156:40354) 2024-01-19T04:30:34.745 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faecb7fe640 1 -- 172.21.15.156:0/3455690945 learned_addr learned my addr 172.21.15.156:0/3455690945 (peer_addr_for_me v1:172.21.15.156:0/0) 2024-01-19T04:30:34.745 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.738+0000 7faeca7fc640 1 --2- 172.21.15.156:0/3455690945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc0cf660 0x7faecc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:34.748 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.742+0000 7faeca7fc640 1 -- 172.21.15.156:0/3455690945 >> v1:172.21.15.156:6789/0 conn(0x7faecc15da50 legacy=0x7faecc159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:34.748 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.742+0000 7faeca7fc640 1 -- 172.21.15.156:0/3455690945 >> v1:172.21.15.133:6789/0 conn(0x7faecc0cf280 legacy=0x7faecc0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:34.748 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.742+0000 7faeca7fc640 1 -- 172.21.15.156:0/3455690945 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc15cf70 con 0x7faecc0cf660 2024-01-19T04:30:34.751 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.746+0000 7faeca7fc640 1 --2- 172.21.15.156:0/3455690945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc0cf660 0x7faecc0c9ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faeb40097f0 tx=0x7faeb401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33137c79bc57b18 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:34.755 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faec9ffb640 1 -- 172.21.15.156:0/3455690945 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40ab600 con 0x7faecc0cf660 2024-01-19T04:30:34.755 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faec9ffb640 1 -- 172.21.15.156:0/3455690945 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb40a7050 con 0x7faecc0cf660 2024-01-19T04:30:34.755 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faec9ffb640 1 -- 172.21.15.156:0/3455690945 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40ab980 con 0x7faecc0cf660 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 -- 172.21.15.156:0/3455690945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc0cf660 msgr2=0x7faecc0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 --2- 172.21.15.156:0/3455690945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc0cf660 0x7faecc0c9ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faeb40097f0 tx=0x7faeb401c480 comp rx=0 tx=0).stop 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 -- 172.21.15.156:0/3455690945 shutdown_connections 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 --2- 172.21.15.156:0/3455690945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc0cf660 0x7faecc0c9ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 -- 172.21.15.156:0/3455690945 >> 172.21.15.156:0/3455690945 conn(0x7faecc08afa0 msgr2=0x7faecc08b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 -- 172.21.15.156:0/3455690945 shutdown_connections 2024-01-19T04:30:34.756 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 -- 172.21.15.156:0/3455690945 wait complete. 2024-01-19T04:30:34.757 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 Processor -- start 2024-01-19T04:30:34.757 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.750+0000 7faed128e640 1 -- start start 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faed128e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faecc0cf280 0x7faecc1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faed128e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faecc0cf660 0x7faecc148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faed128e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 0x7faecc1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faed128e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1443f0 con 0x7faecc0cf280 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faed128e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc152e90 con 0x7faecc0cf660 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faed128e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc144150 con 0x7faecc15da50 2024-01-19T04:30:34.758 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 0x7faecc1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:34.759 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faeca7fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faecc0cf660 0x7faecc148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:34.759 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faecb7fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 0x7faecc1492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46370/0 (socket says 172.21.15.156:46370) 2024-01-19T04:30:34.759 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.754+0000 7faecb7fe640 1 -- 172.21.15.156:0/112450692 learned_addr learned my addr 172.21.15.156:0/112450692 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.758+0000 7faecb7fe640 1 -- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faecc0cf660 msgr2=0x7faecc148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.758+0000 7faecb7fe640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faecc0cf660 0x7faecc148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.758+0000 7faecb7fe640 1 -- 172.21.15.156:0/112450692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faecc0cf280 msgr2=0x7faecc1507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.758+0000 7faecb7fe640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faecc0cf280 0x7faecc1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.758+0000 7faecb7fe640 1 -- 172.21.15.156:0/112450692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4009420 con 0x7faecc15da50 2024-01-19T04:30:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.762+0000 7faecb7fe640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 0x7faecc1492e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faec400ca80 tx=0x7faec400cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:34.770 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.766+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400ac30 con 0x7faecc15da50 2024-01-19T04:30:34.770 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.766+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400ad90 con 0x7faecc15da50 2024-01-19T04:30:34.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.766+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc14d530 con 0x7faecc15da50 2024-01-19T04:30:34.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.766+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4012600 con 0x7faecc15da50 2024-01-19T04:30:34.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.766+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc145430 con 0x7faecc15da50 2024-01-19T04:30:34.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.766+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc074340 con 0x7faecc15da50 2024-01-19T04:30:34.782 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.778+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 2) v1 ==== 42947+0+0 (secure 0 0 0) 0x7faec4007070 con 0x7faecc15da50 2024-01-19T04:30:34.900 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.894+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7faec4011df0 con 0x7faecc15da50 2024-01-19T04:30:34.901 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.894+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7faec40196d0 con 0x7faecc15da50 2024-01-19T04:30:34.974 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:34.970+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4814caa0-7810-463f-af0c-a608320ede1a", "id": 6} v 0) v1 -- 0x7faecc0ca950 con 0x7faecc15da50 2024-01-19T04:30:35.374 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:35.370+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mgrmap(e 3) v1 ==== 85530+0+0 (secure 0 0 0) 0x7faec4007320 con 0x7faecc15da50 2024-01-19T04:30:36.133 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faec37fe640 1 -- 172.21.15.156:0/112450692 <== mon.2 v2:172.21.15.156:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4814caa0-7810-463f-af0c-a608320ede1a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7faec4056da0 con 0x7faecc15da50 2024-01-19T04:30:36.134 INFO:teuthology.orchestra.run.smithi156.stdout:6 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 msgr2=0x7faecc1492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 0x7faecc1492e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faec400ca80 tx=0x7faec400cf40 comp rx=0 tx=0).stop 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 shutdown_connections 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faecc0cf660 0x7faecc148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faecc15da50 0x7faecc1492e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 --2- 172.21.15.156:0/112450692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faecc0cf280 0x7faecc1507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 >> 172.21.15.156:0/112450692 conn(0x7faecc08afa0 msgr2=0x7faecc0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 shutdown_connections 2024-01-19T04:30:36.136 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.130+0000 7faed128e640 1 -- 172.21.15.156:0/112450692 wait complete. 2024-01-19T04:30:36.162 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new fbd4ba15-8512-4dce-98d0-8accfad46c55 7 2024-01-19T04:30:36.283 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 Processor -- start 2024-01-19T04:30:36.284 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 -- start start 2024-01-19T04:30:36.284 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 0x7f668c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:36.284 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f668c1507a0 0x7f668c0c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:36.284 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c0c7c10 con 0x7f668c0c5580 2024-01-19T04:30:36.284 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c159850 con 0x7f668c1507a0 2024-01-19T04:30:36.284 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6692dd4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c159b30 con 0x7f668c0c51a0 2024-01-19T04:30:36.285 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 0x7f668c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:36.285 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 0x7f668c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46372/0 (socket says 172.21.15.156:46372) 2024-01-19T04:30:36.285 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 -- 172.21.15.156:0/1825502396 learned_addr learned my addr 172.21.15.156:0/1825502396 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:36.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 -- 172.21.15.156:0/1825502396 >> v2:172.21.15.156:3300/0 conn(0x7f668c1507a0 msgr2=0x7f668c0c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:36.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 --2- 172.21.15.156:0/1825502396 >> v2:172.21.15.156:3300/0 conn(0x7f668c1507a0 0x7f668c0c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 -- 172.21.15.156:0/1825502396 >> v1:172.21.15.156:6789/0 conn(0x7f668c0c5580 legacy=0x7f668c150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:36.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.282+0000 7f6690b70640 1 -- 172.21.15.156:0/1825502396 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c159e10 con 0x7f668c0c51a0 2024-01-19T04:30:36.291 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.286+0000 7f6690b70640 1 --2- 172.21.15.156:0/1825502396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 0x7f668c0c7620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6684009e50 tx=0x7f668401f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c538fdbb2c5eac6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:36.296 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.290+0000 7f668b7fe640 1 -- 172.21.15.156:0/1825502396 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840af400 con 0x7f668c0c51a0 2024-01-19T04:30:36.297 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.290+0000 7f668b7fe640 1 -- 172.21.15.156:0/1825502396 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66840ab050 con 0x7f668c0c51a0 2024-01-19T04:30:36.297 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.290+0000 7f668b7fe640 1 -- 172.21.15.156:0/1825502396 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840af780 con 0x7f668c0c51a0 2024-01-19T04:30:36.297 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- 172.21.15.156:0/1825502396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 msgr2=0x7f668c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 --2- 172.21.15.156:0/1825502396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 0x7f668c0c7620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6684009e50 tx=0x7f668401f1c0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- 172.21.15.156:0/1825502396 shutdown_connections 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 --2- 172.21.15.156:0/1825502396 >> v2:172.21.15.156:3300/0 conn(0x7f668c1507a0 0x7f668c0c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 --2- 172.21.15.156:0/1825502396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c51a0 0x7f668c0c7620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- 172.21.15.156:0/1825502396 >> 172.21.15.156:0/1825502396 conn(0x7f668c0cb3e0 msgr2=0x7f668c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- 172.21.15.156:0/1825502396 shutdown_connections 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- 172.21.15.156:0/1825502396 wait complete. 2024-01-19T04:30:36.298 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 Processor -- start 2024-01-19T04:30:36.299 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- start start 2024-01-19T04:30:36.299 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0c51a0 0x7f668c13e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:36.299 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 0x7f668c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:36.299 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f668c1507a0 0x7f668c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:36.300 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c149c10 con 0x7f668c1507a0 2024-01-19T04:30:36.300 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c149930 con 0x7f668c0c51a0 2024-01-19T04:30:36.300 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6692dd4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0c9d90 con 0x7f668c0c5580 2024-01-19T04:30:36.300 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f668bfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 0x7f668c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:36.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f668bfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 0x7f668c148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46386/0 (socket says 172.21.15.156:46386) 2024-01-19T04:30:36.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f668bfff640 1 -- 172.21.15.156:0/168670625 learned_addr learned my addr 172.21.15.156:0/168670625 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-01-19T04:30:36.301 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.294+0000 7f6691371640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f668c1507a0 0x7f668c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:36.304 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.298+0000 7f668bfff640 1 -- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0c51a0 msgr2=0x7f668c13e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:36.304 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.298+0000 7f668bfff640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0c51a0 0x7f668c13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.304 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.298+0000 7f668bfff640 1 -- 172.21.15.156:0/168670625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f668c1507a0 msgr2=0x7f668c14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:36.304 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.298+0000 7f668bfff640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f668c1507a0 0x7f668c14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:36.305 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.298+0000 7f668bfff640 1 -- 172.21.15.156:0/168670625 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684009b30 con 0x7f668c0c5580 2024-01-19T04:30:36.307 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.302+0000 7f668bfff640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 0x7f668c148f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f667400c410 tx=0x7f667400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:36.311 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.306+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674003600 con 0x7f668c0c5580 2024-01-19T04:30:36.311 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.306+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674003780 con 0x7f668c0c5580 2024-01-19T04:30:36.311 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.306+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674003b30 con 0x7f668c0c5580 2024-01-19T04:30:36.312 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.306+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c0ca070 con 0x7f668c0c5580 2024-01-19T04:30:36.312 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.306+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c0ca630 con 0x7f668c0c5580 2024-01-19T04:30:36.312 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.306+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c074340 con 0x7f668c0c5580 2024-01-19T04:30:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.330+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 3) v1 ==== 85530+0+0 (secure 0 0 0) 0x7f6674003c90 con 0x7f668c0c5580 2024-01-19T04:30:36.338 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.334+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f66740010f0 con 0x7f668c0c5580 2024-01-19T04:30:36.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.450+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f6674050ee0 con 0x7f668c0c5580 2024-01-19T04:30:36.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.522+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fbd4ba15-8512-4dce-98d0-8accfad46c55", "id": 7} v 0) v1 -- 0x7f668c141d80 con 0x7f668c0c5580 2024-01-19T04:30:36.990 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.990+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mgrmap(e 4) v1 ==== 85657+0+0 (secure 0 0 0) 0x7f6674050990 con 0x7f668c0c5580 2024-01-19T04:30:36.991 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.990+0000 7f66897fa640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f666c0673b0 0x7f666c0697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:36.991 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.990+0000 7f6690b70640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f666c0673b0 0x7f666c0697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:36.992 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:36.990+0000 7f6690b70640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f666c0673b0 0x7f666c0697a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f66840b1000 tx=0x7f6684004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:37.196 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:37.194+0000 7f2a066b1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-19T04:30:37.225 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T04:30:37.226+0000 7f2a066b1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-19T04:30:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.690+0000 7f66897fa640 1 -- 172.21.15.156:0/168670625 <== mon.2 v2:172.21.15.156:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbd4ba15-8512-4dce-98d0-8accfad46c55", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6674077260 con 0x7f668c0c5580 2024-01-19T04:30:37.693 INFO:teuthology.orchestra.run.smithi156.stdout:7 2024-01-19T04:30:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f666c0673b0 msgr2=0x7f666c0697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f666c0673b0 0x7f666c0697a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f66840b1000 tx=0x7f6684004ac0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 msgr2=0x7f668c148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 0x7f668c148f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f667400c410 tx=0x7f667400c8d0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 shutdown_connections 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f666c0673b0 0x7f666c0697a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f668c1507a0 0x7f668c14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f668c0c5580 0x7f668c148f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 --2- 172.21.15.156:0/168670625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0c51a0 0x7f668c13e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 >> 172.21.15.156:0/168670625 conn(0x7f668c0cb3e0 msgr2=0x7f668c0c61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 shutdown_connections 2024-01-19T04:30:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2024-01-19T04:30:37.694+0000 7f6692dd4640 1 -- 172.21.15.156:0/168670625 wait complete. 2024-01-19T04:30:37.715 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-19T04:30:37.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-01-19T04:30:37.717 INFO:tasks.ceph.osd.0:Started 2024-01-19T04:30:37.717 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-19T04:30:37.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-01-19T04:30:37.721 INFO:tasks.ceph.osd.1:Started 2024-01-19T04:30:37.721 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-19T04:30:37.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-01-19T04:30:37.723 INFO:tasks.ceph.osd.2:Started 2024-01-19T04:30:37.723 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-19T04:30:37.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-01-19T04:30:37.725 INFO:tasks.ceph.osd.3:Started 2024-01-19T04:30:37.725 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-19T04:30:37.725 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-01-19T04:30:37.727 INFO:tasks.ceph.osd.4:Started 2024-01-19T04:30:37.728 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-19T04:30:37.728 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-01-19T04:30:37.730 INFO:tasks.ceph.osd.5:Started 2024-01-19T04:30:37.730 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-19T04:30:37.730 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-01-19T04:30:37.732 INFO:tasks.ceph.osd.6:Started 2024-01-19T04:30:37.732 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-19T04:30:37.732 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-01-19T04:30:37.734 INFO:tasks.ceph.osd.7:Started 2024-01-19T04:30:37.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:30:37.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:30:37.856 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:30:37.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.866+0000 7f7e707b8640 1 Processor -- start 2024-01-19T04:30:37.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.866+0000 7f7e707b8640 1 -- start start 2024-01-19T04:30:37.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e707b8640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e68153960 0x7f7e680c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:37.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e707b8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e680c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:37.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e707b8640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e68159740 con 0x7f7e6815cf00 2024-01-19T04:30:37.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e707b8640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e68153d40 con 0x7f7e68153960 2024-01-19T04:30:37.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e707b8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681599e0 con 0x7f7e680c3de0 2024-01-19T04:30:37.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e6e554640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e68153960 0x7f7e680c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:37.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e6dd53640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e680c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:37.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e6dd53640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e680c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:33496/0 (socket says 172.21.15.133:33496) 2024-01-19T04:30:37.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e6e554640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e68153960 0x7f7e680c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:35370/0 (socket says 172.21.15.133:35370) 2024-01-19T04:30:37.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.870+0000 7f7e6dd53640 1 -- 172.21.15.133:0/2717957339 learned_addr learned my addr 172.21.15.133:0/2717957339 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:37.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.874+0000 7f7e6dd53640 1 -- 172.21.15.133:0/2717957339 >> v2:172.21.15.156:3300/0 conn(0x7f7e68153960 msgr2=0x7f7e680c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:37.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.874+0000 7f7e6dd53640 1 --2- 172.21.15.133:0/2717957339 >> v2:172.21.15.156:3300/0 conn(0x7f7e68153960 0x7f7e680c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.874+0000 7f7e6dd53640 1 -- 172.21.15.133:0/2717957339 >> v1:172.21.15.156:6789/0 conn(0x7f7e6815cf00 legacy=0x7f7e6815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:37.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.874+0000 7f7e6dd53640 1 -- 172.21.15.133:0/2717957339 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68159cc0 con 0x7f7e680c3de0 2024-01-19T04:30:37.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.874+0000 7f7e6dd53640 1 --2- 172.21.15.133:0/2717957339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e680c4220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009870 tx=0x7f7e5801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dfabaf858299283 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:37.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e6d552640 1 -- 172.21.15.133:0/2717957339 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580a8a30 con 0x7f7e680c3de0 2024-01-19T04:30:37.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e6d552640 1 -- 172.21.15.133:0/2717957339 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e580a8b90 con 0x7f7e680c3de0 2024-01-19T04:30:37.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e6d552640 1 -- 172.21.15.133:0/2717957339 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580b0440 con 0x7f7e680c3de0 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 -- 172.21.15.133:0/2717957339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 msgr2=0x7f7e680c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2717957339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e680c4220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009870 tx=0x7f7e5801ed30 comp rx=0 tx=0).stop 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 -- 172.21.15.133:0/2717957339 shutdown_connections 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2717957339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e680c4220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2717957339 >> v2:172.21.15.156:3300/0 conn(0x7f7e68153960 0x7f7e680c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 -- 172.21.15.133:0/2717957339 >> 172.21.15.133:0/2717957339 conn(0x7f7e6808afa0 msgr2=0x7f7e6808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 -- 172.21.15.133:0/2717957339 shutdown_connections 2024-01-19T04:30:37.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.878+0000 7f7e707b8640 1 -- 172.21.15.133:0/2717957339 wait complete. 2024-01-19T04:30:37.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 Processor -- start 2024-01-19T04:30:37.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 -- start start 2024-01-19T04:30:37.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e6814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:37.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e68153960 0x7f7e6814a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:37.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6815cf00 0x7f7e6814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:37.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680c9190 con 0x7f7e68153960 2024-01-19T04:30:37.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680c82e0 con 0x7f7e6815cf00 2024-01-19T04:30:37.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e707b8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680c8580 con 0x7f7e680c3de0 2024-01-19T04:30:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e6e554640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e6814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e6ed55640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6815cf00 0x7f7e6814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e6e554640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e6814dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:33510/0 (socket says 172.21.15.133:33510) 2024-01-19T04:30:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.882+0000 7f7e6e554640 1 -- 172.21.15.133:0/2821403148 learned_addr learned my addr 172.21.15.133:0/2821403148 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:37.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.886+0000 7f7e6e554640 1 -- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6815cf00 msgr2=0x7f7e6814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:37.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.886+0000 7f7e6e554640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6815cf00 0x7f7e6814ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.886+0000 7f7e6e554640 1 -- 172.21.15.133:0/2821403148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e68153960 msgr2=0x7f7e6814a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.886+0000 7f7e6e554640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e68153960 0x7f7e6814a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.886+0000 7f7e6e554640 1 -- 172.21.15.133:0/2821403148 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580094d0 con 0x7f7e680c3de0 2024-01-19T04:30:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.886+0000 7f7e6ed55640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6815cf00 0x7f7e6814ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:30:37.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.890+0000 7f7e6e554640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e6814dbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000e9b0 tx=0x7f7e6000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.894+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000c9a0 con 0x7f7e680c3de0 2024-01-19T04:30:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.894+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000cb00 con 0x7f7e680c3de0 2024-01-19T04:30:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.894+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000ce90 con 0x7f7e680c3de0 2024-01-19T04:30:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.894+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e680c8860 con 0x7f7e680c3de0 2024-01-19T04:30:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.894+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e680c8e20 con 0x7f7e680c3de0 2024-01-19T04:30:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.894+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68067100 con 0x7f7e680c3de0 2024-01-19T04:30:37.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.918+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 85657+0+0 (secure 0 0 0) 0x7f7e60013470 con 0x7f7e680c3de0 2024-01-19T04:30:37.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.918+0000 7f7e5effd640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e4c0663d0 0x7f7e4c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:37.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.918+0000 7f7e6dd53640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e4c0663d0 0x7f7e4c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:37.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:37.918+0000 7f7e6dd53640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e4c0663d0 0x7f7e4c068890 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7e580b2000 tx=0x7f7e58004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:38.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.170+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7e600557d0 con 0x7f7e680c3de0 2024-01-19T04:30:38.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.170+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7e60051b10 con 0x7f7e680c3de0 2024-01-19T04:30:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.278+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mgrmap(e 5) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f7e60051ee0 con 0x7f7e680c3de0 2024-01-19T04:30:38.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.326+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e68074340 con 0x7f7e680c3de0 2024-01-19T04:30:38.358 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-19T04:30:38.358+0000 7f74e7c6e640 -1 Falling back to public interface 2024-01-19T04:30:38.379 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-01-19T04:30:38.378+0000 7efcc295f640 -1 Falling back to public interface 2024-01-19T04:30:38.386 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-01-19T04:30:38.386+0000 7f3917d85640 -1 Falling back to public interface 2024-01-19T04:30:38.394 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-19T04:30:38.394+0000 7fad3a846640 -1 Falling back to public interface 2024-01-19T04:30:38.409 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-19T04:30:38.410+0000 7fdcac436640 -1 Falling back to public interface 2024-01-19T04:30:38.418 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-01-19T04:30:38.418+0000 7fd67cdf6640 -1 Falling back to public interface 2024-01-19T04:30:38.418 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-01-19T04:30:38.418+0000 7f4a18415640 -1 Falling back to public interface 2024-01-19T04:30:38.454 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-19T04:30:38.454+0000 7f6c65ed6640 -1 Falling back to public interface 2024-01-19T04:30:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e5effd640 1 -- 172.21.15.133:0/2821403148 <== mon.2 v2:172.21.15.156:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7e60021090 con 0x7f7e680c3de0 2024-01-19T04:30:38.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:30:38.550 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:30:37.220098+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:30:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e4c0663d0 msgr2=0x7f7e4c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e4c0663d0 0x7f7e4c068890 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7e580b2000 tx=0x7f7e58004740 comp rx=0 tx=0).stop 2024-01-19T04:30:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 msgr2=0x7f7e6814dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e6814dbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000e9b0 tx=0x7f7e6000ee70 comp rx=0 tx=0).stop 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 shutdown_connections 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e4c0663d0 0x7f7e4c068890 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6815cf00 0x7f7e6814ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e68153960 0x7f7e6814a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 --2- 172.21.15.133:0/2821403148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680c3de0 0x7f7e6814dbd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 >> 172.21.15.133:0/2821403148 conn(0x7f7e6808afa0 msgr2=0x7f7e68151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 shutdown_connections 2024-01-19T04:30:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:30:38.546+0000 7f7e707b8640 1 -- 172.21.15.133:0/2821403148 wait complete. 2024-01-19T04:30:38.576 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-19T04:30:38.576 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-19T04:30:39.383 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T04:30:39.504 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.502+0000 7fcd39564640 1 Processor -- start 2024-01-19T04:30:39.504 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.502+0000 7fcd39564640 1 -- start start 2024-01-19T04:30:39.505 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd39564640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd3414fcd0 0x7fcd340c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:39.505 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd39564640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcd340c70f0 0x7fcd34156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:39.506 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd39564640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd340c9520 con 0x7fcd340729a0 2024-01-19T04:30:39.506 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd39564640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd34155cd0 con 0x7fcd3414fcd0 2024-01-19T04:30:39.506 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd39564640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340c89a0 con 0x7fcd340c70f0 2024-01-19T04:30:39.506 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd32ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd3414fcd0 0x7fcd340c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:39.506 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd32ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd3414fcd0 0x7fcd340c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46300/0 (socket says 172.21.15.133:46300) 2024-01-19T04:30:39.506 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd32ffd640 1 -- 172.21.15.133:0/1056623693 learned_addr learned my addr 172.21.15.133:0/1056623693 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:39.507 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.506+0000 7fcd327fc640 1 --2- 172.21.15.133:0/1056623693 >> v2:172.21.15.156:3300/0 conn(0x7fcd340c70f0 0x7fcd34156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:39.509 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.510+0000 7fcd32ffd640 1 -- 172.21.15.133:0/1056623693 >> v2:172.21.15.156:3300/0 conn(0x7fcd340c70f0 msgr2=0x7fcd34156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:39.509 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.510+0000 7fcd32ffd640 1 --2- 172.21.15.133:0/1056623693 >> v2:172.21.15.156:3300/0 conn(0x7fcd340c70f0 0x7fcd34156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:39.509 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.510+0000 7fcd32ffd640 1 -- 172.21.15.133:0/1056623693 >> v1:172.21.15.156:6789/0 conn(0x7fcd340729a0 legacy=0x7fcd340b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:39.509 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.510+0000 7fcd32ffd640 1 -- 172.21.15.133:0/1056623693 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340c8c80 con 0x7fcd3414fcd0 2024-01-19T04:30:39.512 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.510+0000 7fcd32ffd640 1 --2- 172.21.15.133:0/1056623693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd340c5500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406f8a0 tx=0x7fcd2401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7900ea14f20e2d6f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:39.514 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.514+0000 7fcd31ffb640 1 -- 172.21.15.133:0/1056623693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240ab600 con 0x7fcd3414fcd0 2024-01-19T04:30:39.516 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.514+0000 7fcd31ffb640 1 -- 172.21.15.133:0/1056623693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd240a7050 con 0x7fcd3414fcd0 2024-01-19T04:30:39.516 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.514+0000 7fcd31ffb640 1 -- 172.21.15.133:0/1056623693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240ab980 con 0x7fcd3414fcd0 2024-01-19T04:30:39.517 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- 172.21.15.133:0/1056623693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 msgr2=0x7fcd340c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:39.517 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 --2- 172.21.15.133:0/1056623693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd340c5500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406f8a0 tx=0x7fcd2401c490 comp rx=0 tx=0).stop 2024-01-19T04:30:39.517 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- 172.21.15.133:0/1056623693 shutdown_connections 2024-01-19T04:30:39.518 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 --2- 172.21.15.133:0/1056623693 >> v2:172.21.15.156:3300/0 conn(0x7fcd340c70f0 0x7fcd34156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:39.518 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 --2- 172.21.15.133:0/1056623693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd340c5500 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:39.518 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- 172.21.15.133:0/1056623693 >> 172.21.15.133:0/1056623693 conn(0x7fcd3406d440 msgr2=0x7fcd3406ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:39.518 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- 172.21.15.133:0/1056623693 shutdown_connections 2024-01-19T04:30:39.518 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- 172.21.15.133:0/1056623693 wait complete. 2024-01-19T04:30:39.519 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 Processor -- start 2024-01-19T04:30:39.519 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- start start 2024-01-19T04:30:39.519 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd340729a0 0x7fcd3413e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:39.519 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcd340c70f0 0x7fcd3414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd3414e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340cb400 con 0x7fcd3414fcd0 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340cace0 con 0x7fcd340729a0 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd39564640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340c4c70 con 0x7fcd340c70f0 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd3414e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd3414e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46310/0 (socket says 172.21.15.133:46310) 2024-01-19T04:30:39.520 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.518+0000 7fcd337fe640 1 -- 172.21.15.133:0/2550615677 learned_addr learned my addr 172.21.15.133:0/2550615677 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:39.521 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd327fc640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcd340c70f0 0x7fcd3414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:39.522 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd32ffd640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd340729a0 0x7fcd3413e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:39.524 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd337fe640 1 -- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcd340c70f0 msgr2=0x7fcd3414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:39.524 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd337fe640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcd340c70f0 0x7fcd3414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:39.524 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd337fe640 1 -- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd340729a0 msgr2=0x7fcd3413e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:39.524 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd337fe640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd340729a0 0x7fcd3413e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:39.524 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.522+0000 7fcd337fe640 1 -- 172.21.15.133:0/2550615677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240094d0 con 0x7fcd3414fcd0 2024-01-19T04:30:39.526 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.526+0000 7fcd337fe640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd3414e7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c780 tx=0x7fcd2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:39.528 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.526+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c003d90 con 0x7fcd3414fcd0 2024-01-19T04:30:39.528 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.526+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3414ef40 con 0x7fcd3414fcd0 2024-01-19T04:30:39.528 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.526+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd341412d0 con 0x7fcd3414fcd0 2024-01-19T04:30:39.529 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.530+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd34072440 con 0x7fcd3414fcd0 2024-01-19T04:30:39.530 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.530+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c00ce90 con 0x7fcd3414fcd0 2024-01-19T04:30:39.530 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.530+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c006d60 con 0x7fcd3414fcd0 2024-01-19T04:30:39.838 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.838+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85763+0+0 (secure 0 0 0) 0x7fcd2c005070 con 0x7fcd3414fcd0 2024-01-19T04:30:39.839 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.838+0000 7fcd1b7fe640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcd200664a0 0x7fcd20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:39.840 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.838+0000 7fcd32ffd640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcd200664a0 0x7fcd20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:39.841 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.842+0000 7fcd32ffd640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcd200664a0 0x7fcd20068960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd240ad000 tx=0x7fcd240a6000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:39.872 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.870+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcd2c054ad0 con 0x7fcd3414fcd0 2024-01-19T04:30:39.873 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:39.870+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcd2c050e10 con 0x7fcd3414fcd0 2024-01-19T04:30:40.040 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.038+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd34071ad0 con 0x7fcd3414fcd0 2024-01-19T04:30:40.115 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.114+0000 7fcd1b7fe640 1 -- 172.21.15.133:0/2550615677 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fcd2c021090 con 0x7fcd3414fcd0 2024-01-19T04:30:40.116 INFO:teuthology.misc.health.smithi133.stdout: 2024-01-19T04:30:40.116 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:30:37.220098+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcd200664a0 msgr2=0x7fcd20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcd200664a0 0x7fcd20068960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd240ad000 tx=0x7fcd240a6000 comp rx=0 tx=0).stop 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 msgr2=0x7fcd3414e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd3414e7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c780 tx=0x7fcd2c00cc40 comp rx=0 tx=0).stop 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 shutdown_connections 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcd200664a0 0x7fcd20068960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd3414fcd0 0x7fcd3414e7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:40.119 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcd340c70f0 0x7fcd3414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:40.120 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 --2- 172.21.15.133:0/2550615677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd340729a0 0x7fcd3413e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:40.120 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 >> 172.21.15.133:0/2550615677 conn(0x7fcd3406d440 msgr2=0x7fcd34070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:40.120 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 shutdown_connections 2024-01-19T04:30:40.120 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:40.118+0000 7fcd39564640 1 -- 172.21.15.133:0/2550615677 wait complete. 2024-01-19T04:30:40.135 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-19T04:30:42.110 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-19T04:30:42.110+0000 7f74e7c6e640 -1 osd.0 0 log_to_monitors true 2024-01-19T04:30:42.204 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-01-19T04:30:42.202+0000 7efcc295f640 -1 osd.7 0 log_to_monitors true 2024-01-19T04:30:42.219 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-01-19T04:30:42.218+0000 7f3917d85640 -1 osd.4 0 log_to_monitors true 2024-01-19T04:30:42.228 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-19T04:30:42.226+0000 7fdcac436640 -1 osd.1 0 log_to_monitors true 2024-01-19T04:30:42.299 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-19T04:30:42.298+0000 7fad3a846640 -1 osd.2 0 log_to_monitors true 2024-01-19T04:30:42.312 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-01-19T04:30:42.310+0000 7fd67cdf6640 -1 osd.5 0 log_to_monitors true 2024-01-19T04:30:42.318 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-01-19T04:30:42.318+0000 7f4a18415640 -1 osd.6 0 log_to_monitors true 2024-01-19T04:30:42.330 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-19T04:30:42.330+0000 7f6c65ed6640 -1 osd.3 0 log_to_monitors true 2024-01-19T04:30:44.244 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-01-19T04:30:44.242+0000 7efcbe908640 -1 osd.7 0 waiting for initial osdmap 2024-01-19T04:30:44.375 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-01-19T04:30:44.374+0000 7efcb6743640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:44.541 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-19T04:30:44.542+0000 7f74e3c17640 -1 osd.0 0 waiting for initial osdmap 2024-01-19T04:30:44.586 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-19T04:30:44.586+0000 7f74dba52640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.178 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-01-19T04:30:46.174+0000 7f3914540640 -1 osd.4 0 waiting for initial osdmap 2024-01-19T04:30:46.192 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-01-19T04:30:46.190+0000 7f4a143be640 -1 osd.6 0 waiting for initial osdmap 2024-01-19T04:30:46.211 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-01-19T04:30:46.210+0000 7fd678d9f640 -1 osd.5 0 waiting for initial osdmap 2024-01-19T04:30:46.242 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-01-19T04:30:46.242+0000 7f390bb69640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.254 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-01-19T04:30:46.254+0000 7fd670bda640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.254 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-01-19T04:30:46.254+0000 7f4a0c1f9640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.570 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-19T04:30:46.570+0000 7f6c62691640 -1 osd.3 0 waiting for initial osdmap 2024-01-19T04:30:46.602 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-19T04:30:46.602+0000 7f6c59cba640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.613 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-19T04:30:46.614+0000 7fad367ef640 -1 osd.2 0 waiting for initial osdmap 2024-01-19T04:30:46.637 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-19T04:30:46.638+0000 7fdca83df640 -1 osd.1 0 waiting for initial osdmap 2024-01-19T04:30:46.706 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-19T04:30:46.706+0000 7fad2e62a640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.722 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-19T04:30:46.722+0000 7fdca021a640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:30:46.942 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T04:30:47.061 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 Processor -- start 2024-01-19T04:30:47.061 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 -- start start 2024-01-19T04:30:47.062 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c43e0 0x7f287c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:47.062 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287c157d60 0x7f287c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:47.062 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0c7d10 con 0x7f287c0c47c0 2024-01-19T04:30:47.062 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c158210 con 0x7f287c157d60 2024-01-19T04:30:47.062 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f28831e4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1572a0 con 0x7f287c0c43e0 2024-01-19T04:30:47.063 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f2881781640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287c157d60 0x7f287c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:47.063 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f2881781640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287c157d60 0x7f287c06ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52774/0 (socket says 172.21.15.133:52774) 2024-01-19T04:30:47.063 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.062+0000 7f2881781640 1 -- 172.21.15.133:0/124006400 learned_addr learned my addr 172.21.15.133:0/124006400 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:47.066 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.066+0000 7f2881781640 1 -- 172.21.15.133:0/124006400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c43e0 msgr2=0x7f287c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:47.066 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.066+0000 7f2881781640 1 --2- 172.21.15.133:0/124006400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c43e0 0x7f287c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.066 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.066+0000 7f2881781640 1 -- 172.21.15.133:0/124006400 >> v1:172.21.15.133:6789/0 conn(0x7f287c0c47c0 legacy=0x7f287c0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:47.066 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.066+0000 7f2881781640 1 -- 172.21.15.133:0/124006400 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0c7fd0 con 0x7f287c157d60 2024-01-19T04:30:47.070 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.070+0000 7f2881781640 1 --2- 172.21.15.133:0/124006400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c157d60 0x7f287c06ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e50 tx=0x7f286c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04010db5b2845fe server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:47.073 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f287b7fe640 1 -- 172.21.15.133:0/124006400 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0af400 con 0x7f287c157d60 2024-01-19T04:30:47.075 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f287b7fe640 1 -- 172.21.15.133:0/124006400 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c0ab050 con 0x7f287c157d60 2024-01-19T04:30:47.075 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f287b7fe640 1 -- 172.21.15.133:0/124006400 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0af780 con 0x7f287c157d60 2024-01-19T04:30:47.076 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 -- 172.21.15.133:0/124006400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c157d60 msgr2=0x7f287c06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:47.076 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 --2- 172.21.15.133:0/124006400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c157d60 0x7f287c06ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e50 tx=0x7f286c01f1c0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 -- 172.21.15.133:0/124006400 shutdown_connections 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 --2- 172.21.15.133:0/124006400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c157d60 0x7f287c06ac00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 --2- 172.21.15.133:0/124006400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c43e0 0x7f287c15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 -- 172.21.15.133:0/124006400 >> 172.21.15.133:0/124006400 conn(0x7f287c06d440 msgr2=0x7f287c06ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 -- 172.21.15.133:0/124006400 shutdown_connections 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.074+0000 7f28831e4640 1 -- 172.21.15.133:0/124006400 wait complete. 2024-01-19T04:30:47.077 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 Processor -- start 2024-01-19T04:30:47.078 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 -- start start 2024-01-19T04:30:47.078 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 0x7f287c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:47.078 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c47c0 0x7f287c1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f287c157d60 0x7f287c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0c36b0 con 0x7f287c0c43e0 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0c2b30 con 0x7f287c157d60 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f28831e4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0c2e10 con 0x7f287c0c47c0 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f2880f80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 0x7f287c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f2880f80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 0x7f287c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52784/0 (socket says 172.21.15.133:52784) 2024-01-19T04:30:47.079 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.078+0000 7f2880f80640 1 -- 172.21.15.133:0/628384290 learned_addr learned my addr 172.21.15.133:0/628384290 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:47.082 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.082+0000 7f2880f80640 1 -- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c47c0 msgr2=0x7f287c1ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:47.082 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.082+0000 7f2880f80640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c47c0 0x7f287c1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.082 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.082+0000 7f2880f80640 1 -- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f287c157d60 msgr2=0x7f287c150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:47.082 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.082+0000 7f2880f80640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f287c157d60 0x7f287c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.083 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.082+0000 7f2880f80640 1 -- 172.21.15.133:0/628384290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009b30 con 0x7f287c0c43e0 2024-01-19T04:30:47.084 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.082+0000 7f2880f80640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 0x7f287c15a540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f287400b410 tx=0x7f287400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:47.089 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.086+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874011830 con 0x7f287c0c43e0 2024-01-19T04:30:47.089 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.090+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874011990 con 0x7f287c0c43e0 2024-01-19T04:30:47.089 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.090+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c0c30f0 con 0x7f287c0c43e0 2024-01-19T04:30:47.089 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.090+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874011d40 con 0x7f287c0c43e0 2024-01-19T04:30:47.089 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.090+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c14fd70 con 0x7f287c0c43e0 2024-01-19T04:30:47.090 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.090+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c14fbd0 con 0x7f287c0c43e0 2024-01-19T04:30:47.110 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.110+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f287401a400 con 0x7f287c0c43e0 2024-01-19T04:30:47.110 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.110+0000 7f28797fa640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f285c0664c0 0x7f285c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:47.111 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.110+0000 7f287bfff640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f285c0664c0 0x7f285c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:47.111 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.110+0000 7f287bfff640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f285c0664c0 0x7f285c068980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2864007fd0 tx=0x7f28640079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:47.483 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.482+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f287400f2e0 con 0x7f287c0c43e0 2024-01-19T04:30:47.483 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.482+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f28740516e0 con 0x7f287c0c43e0 2024-01-19T04:30:47.648 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.646+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c14fbd0 con 0x7f287c0c43e0 2024-01-19T04:30:47.938 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28797fa640 1 -- 172.21.15.133:0/628384290 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11793 (secure 0 0 0) 0x7f287c14fbd0 con 0x7f287c0c43e0 2024-01-19T04:30:47.938 INFO:teuthology.misc.health.smithi133.stdout: 2024-01-19T04:30:47.939 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":15,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:30:46.763072+0000","last_up_change":"2024-01-19T04:30:46.763072+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:30:47.940 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f285c0664c0 msgr2=0x7f285c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f285c0664c0 0x7f285c068980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2864007fd0 tx=0x7f28640079a0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 msgr2=0x7f287c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 0x7f287c15a540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f287400b410 tx=0x7f287400b8d0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 shutdown_connections 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f285c0664c0 0x7f285c068980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f287c157d60 0x7f287c150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f287c0c47c0 0x7f287c1ef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 --2- 172.21.15.133:0/628384290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287c0c43e0 0x7f287c15a540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 >> 172.21.15.133:0/628384290 conn(0x7f287c06d440 msgr2=0x7f287c0ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 shutdown_connections 2024-01-19T04:30:47.941 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:47.938+0000 7f28831e4640 1 -- 172.21.15.133:0/628384290 wait complete. 2024-01-19T04:30:47.958 DEBUG:teuthology.misc:6 of 8 OSDs are up 2024-01-19T04:30:54.765 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T04:30:54.877 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 Processor -- start 2024-01-19T04:30:54.877 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 -- start start 2024-01-19T04:30:54.878 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f693c0c8650 0x7f693c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:54.878 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f693c15cb90 0x7f693c153480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:54.878 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0c6e70 con 0x7f693c0c8270 2024-01-19T04:30:54.878 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c15a580 con 0x7f693c15cb90 2024-01-19T04:30:54.878 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f6941acc640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c06a8b0 con 0x7f693c0c8650 2024-01-19T04:30:54.879 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f693bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f693c15cb90 0x7f693c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:54.880 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f693affd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f693c0c8650 0x7f693c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:54.880 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f693bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f693c15cb90 0x7f693c153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37318/0 (socket says 172.21.15.133:37318) 2024-01-19T04:30:54.880 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.878+0000 7f693bfff640 1 -- 172.21.15.133:0/3178737615 learned_addr learned my addr 172.21.15.133:0/3178737615 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:54.883 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.882+0000 7f693bfff640 1 -- 172.21.15.133:0/3178737615 >> v2:172.21.15.156:3300/0 conn(0x7f693c0c8650 msgr2=0x7f693c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:54.883 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.882+0000 7f693bfff640 1 --2- 172.21.15.133:0/3178737615 >> v2:172.21.15.156:3300/0 conn(0x7f693c0c8650 0x7f693c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:54.884 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.882+0000 7f693bfff640 1 -- 172.21.15.133:0/3178737615 >> v1:172.21.15.156:6789/0 conn(0x7f693c0c8270 legacy=0x7f693c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:30:54.884 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.882+0000 7f693bfff640 1 -- 172.21.15.133:0/3178737615 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c15d090 con 0x7f693c15cb90 2024-01-19T04:30:54.889 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:54.890+0000 7f693bfff640 1 --2- 172.21.15.133:0/3178737615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c15cb90 0x7f693c153480 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f693c0c7fe0 tx=0x7f693401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6076679a793f6bb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:30:58.025 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f693a7fc640 1 -- 172.21.15.133:0/3178737615 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69340a5740 con 0x7f693c15cb90 2024-01-19T04:30:58.025 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f693a7fc640 1 -- 172.21.15.133:0/3178737615 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69340a58c0 con 0x7f693c15cb90 2024-01-19T04:30:58.026 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f693a7fc640 1 -- 172.21.15.133:0/3178737615 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69340a5cb0 con 0x7f693c15cb90 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 -- 172.21.15.133:0/3178737615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c15cb90 msgr2=0x7f693c153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 --2- 172.21.15.133:0/3178737615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c15cb90 0x7f693c153480 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f693c0c7fe0 tx=0x7f693401c990 comp rx=0 tx=0).stop 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 -- 172.21.15.133:0/3178737615 shutdown_connections 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 --2- 172.21.15.133:0/3178737615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c15cb90 0x7f693c153480 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 --2- 172.21.15.133:0/3178737615 >> v2:172.21.15.156:3300/0 conn(0x7f693c0c8650 0x7f693c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 -- 172.21.15.133:0/3178737615 >> 172.21.15.133:0/3178737615 conn(0x7f693c0cb750 msgr2=0x7f693c0cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 -- 172.21.15.133:0/3178737615 shutdown_connections 2024-01-19T04:30:58.027 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.026+0000 7f6941acc640 1 -- 172.21.15.133:0/3178737615 wait complete. 2024-01-19T04:30:58.029 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 Processor -- start 2024-01-19T04:30:58.029 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 -- start start 2024-01-19T04:30:58.031 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 0x7f693c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:58.032 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f693c0c8650 0x7f693c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:58.032 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693c15cb90 0x7f693c1f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:30:58.032 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c14fb80 con 0x7f693c0c8270 2024-01-19T04:30:58.032 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1f2d90 con 0x7f693c0c8650 2024-01-19T04:30:58.032 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f6941acc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c154570 con 0x7f693c15cb90 2024-01-19T04:30:58.032 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.030+0000 7f693b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 0x7f693c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:58.033 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.034+0000 7f693bfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693c15cb90 0x7f693c1f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:30:58.033 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.034+0000 7f693b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 0x7f693c15a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37322/0 (socket says 172.21.15.133:37322) 2024-01-19T04:30:58.033 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.034+0000 7f693b7fe640 1 -- 172.21.15.133:0/1310370903 learned_addr learned my addr 172.21.15.133:0/1310370903 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:30:58.039 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.038+0000 7f693b7fe640 1 -- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693c15cb90 msgr2=0x7f693c1f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:58.039 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.038+0000 7f693b7fe640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693c15cb90 0x7f693c1f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:58.039 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.038+0000 7f693b7fe640 1 -- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f693c0c8650 msgr2=0x7f693c153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:30:58.039 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.038+0000 7f693b7fe640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f693c0c8650 0x7f693c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:30:58.039 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.038+0000 7f693b7fe640 1 -- 172.21.15.133:0/1310370903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934009b30 con 0x7f693c0c8270 2024-01-19T04:30:58.049 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:30:58.050+0000 7f693b7fe640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 0x7f693c15a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c450 tx=0x7f692c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:03.338 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.338+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c012830 con 0x7f693c0c8270 2024-01-19T04:31:03.338 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.338+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c0129d0 con 0x7f693c0c8270 2024-01-19T04:31:03.338 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.338+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c154850 con 0x7f693c0c8270 2024-01-19T04:31:03.338 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.338+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c012d80 con 0x7f693c0c8270 2024-01-19T04:31:03.339 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.338+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c1f3050 con 0x7f693c0c8270 2024-01-19T04:31:03.340 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.338+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c154d70 con 0x7f693c0c8270 2024-01-19T04:31:03.702 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.702+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f692c025430 con 0x7f693c0c8270 2024-01-19T04:31:03.702 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.702+0000 7f6923fff640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f69280665a0 0x7f6928068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:03.703 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.702+0000 7f693affd640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f69280665a0 0x7f6928068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:03.704 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.702+0000 7f693affd640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f69280665a0 0x7f6928068a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6930006aa0 tx=0x7f6930006a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:03.741 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.742+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f692c0551f0 con 0x7f693c0c8270 2024-01-19T04:31:03.756 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.754+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f692c051530 con 0x7f693c0c8270 2024-01-19T04:31:03.946 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:03.946+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f693c0741c0 con 0x7f693c0c8270 2024-01-19T04:31:04.143 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.142+0000 7f6923fff640 1 -- 172.21.15.133:0/1310370903 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12899 (secure 0 0 0) 0x7f692c020020 con 0x7f693c0c8270 2024-01-19T04:31:04.143 INFO:teuthology.misc.health.smithi133.stdout: 2024-01-19T04:31:04.144 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":18,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:30:51.169776+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f69280665a0 msgr2=0x7f6928068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f69280665a0 0x7f6928068a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6930006aa0 tx=0x7f6930006a30 comp rx=0 tx=0).stop 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 msgr2=0x7f693c15a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 0x7f693c15a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c450 tx=0x7f692c00c910 comp rx=0 tx=0).stop 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 shutdown_connections 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f69280665a0 0x7f6928068a60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f693c0c8650 0x7f693c153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.147 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693c15cb90 0x7f693c1f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.148 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 --2- 172.21.15.133:0/1310370903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f693c0c8270 0x7f693c15a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.148 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 >> 172.21.15.133:0/1310370903 conn(0x7f693c0cb750 msgr2=0x7f693c06f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:04.148 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 shutdown_connections 2024-01-19T04:31:04.148 INFO:teuthology.misc.health.smithi133.stderr:2024-01-19T04:31:04.146+0000 7f6941acc640 1 -- 172.21.15.133:0/1310370903 wait complete. 2024-01-19T04:31:04.167 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-19T04:31:04.167 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-19T04:31:04.167 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-19T04:31:04.168 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T04:31:04.168 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-01-19T04:31:04.170 INFO:tasks.ceph.mds.a:Started 2024-01-19T04:31:04.170 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-19T04:31:04.170 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-19T04:31:04.170 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-01-19T04:31:04.173 INFO:tasks.ceph.mds.c:Started 2024-01-19T04:31:04.173 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-19T04:31:04.173 INFO:tasks.ceph.mds.e:Restarting daemon 2024-01-19T04:31:04.173 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-01-19T04:31:04.175 INFO:tasks.ceph.mds.e:Started 2024-01-19T04:31:04.175 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-19T04:31:04.176 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T04:31:04.176 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-01-19T04:31:04.178 INFO:tasks.ceph.mds.b:Started 2024-01-19T04:31:04.179 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-19T04:31:04.179 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-19T04:31:04.179 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-01-19T04:31:04.181 INFO:tasks.ceph.mds.d:Started 2024-01-19T04:31:04.181 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-19T04:31:04.181 INFO:tasks.ceph.mds.f:Restarting daemon 2024-01-19T04:31:04.182 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-01-19T04:31:04.184 INFO:tasks.ceph.mds.f:Started 2024-01-19T04:31:04.184 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-19T04:31:04.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:04.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 Processor -- start 2024-01-19T04:31:04.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 -- start start 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f5414fea0 0x7f6f540c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f54159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f54159d80 0x7f6f54066460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540c3270 con 0x7f6f5414fea0 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540c3e50 con 0x7f6f54159d80 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f5a2c4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54150280 con 0x7f6f54156580 2024-01-19T04:31:04.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.338+0000 7f6f537fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f54159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:04.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.342+0000 7f6f537fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f54159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:39944/0 (socket says 172.21.15.133:39944) 2024-01-19T04:31:04.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.342+0000 7f6f537fe640 1 -- 172.21.15.133:0/3872734593 learned_addr learned my addr 172.21.15.133:0/3872734593 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:04.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.342+0000 7f6f58861640 1 --2- 172.21.15.133:0/3872734593 >> v2:172.21.15.156:3300/0 conn(0x7f6f54159d80 0x7f6f54066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.346+0000 7f6f537fe640 1 -- 172.21.15.133:0/3872734593 >> v2:172.21.15.156:3300/0 conn(0x7f6f54159d80 msgr2=0x7f6f54066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.346+0000 7f6f537fe640 1 --2- 172.21.15.133:0/3872734593 >> v2:172.21.15.156:3300/0 conn(0x7f6f54159d80 0x7f6f54066460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.346+0000 7f6f537fe640 1 -- 172.21.15.133:0/3872734593 >> v2:172.21.15.133:3300/0 conn(0x7f6f5414fea0 msgr2=0x7f6f540c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.346+0000 7f6f537fe640 1 --2- 172.21.15.133:0/3872734593 >> v2:172.21.15.133:3300/0 conn(0x7f6f5414fea0 0x7f6f540c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.346+0000 7f6f537fe640 1 -- 172.21.15.133:0/3872734593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f541590d0 con 0x7f6f54156580 2024-01-19T04:31:04.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.350+0000 7f6f537fe640 1 --2- 172.21.15.133:0/3872734593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f54159840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f540c8810 tx=0x7f6f4801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b4c3c630709ad4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f52ffd640 1 -- 172.21.15.133:0/3872734593 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480a89b0 con 0x7f6f54156580 2024-01-19T04:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f52ffd640 1 -- 172.21.15.133:0/3872734593 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f480a8b10 con 0x7f6f54156580 2024-01-19T04:31:04.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f52ffd640 1 -- 172.21.15.133:0/3872734593 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480a8ea0 con 0x7f6f54156580 2024-01-19T04:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3872734593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 msgr2=0x7f6f54159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3872734593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f54159840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f540c8810 tx=0x7f6f4801ecf0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3872734593 shutdown_connections 2024-01-19T04:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3872734593 >> v2:172.21.15.156:3300/0 conn(0x7f6f54159d80 0x7f6f54066460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3872734593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f54159840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3872734593 >> v2:172.21.15.133:3300/0 conn(0x7f6f5414fea0 0x7f6f540c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3872734593 >> 172.21.15.133:0/3872734593 conn(0x7f6f540cbb60 msgr2=0x7f6f540c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:04.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3872734593 shutdown_connections 2024-01-19T04:31:04.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.358+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3872734593 wait complete. 2024-01-19T04:31:04.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 Processor -- start 2024-01-19T04:31:04.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 -- start start 2024-01-19T04:31:04.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f5414fea0 0x7f6f541f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f5414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f54159d80 0x7f6f5414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5414de00 con 0x7f6f54159d80 2024-01-19T04:31:04.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540c25b0 con 0x7f6f5414fea0 2024-01-19T04:31:04.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f5a2c4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5414cb90 con 0x7f6f54156580 2024-01-19T04:31:04.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f537fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f5414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:04.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f537fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f5414bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:39946/0 (socket says 172.21.15.133:39946) 2024-01-19T04:31:04.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f537fe640 1 -- 172.21.15.133:0/3929746305 learned_addr learned my addr 172.21.15.133:0/3929746305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:04.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.362+0000 7f6f53fff640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f5414fea0 0x7f6f541f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:04.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.370+0000 7f6f537fe640 1 -- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f5414fea0 msgr2=0x7f6f541f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:04.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.370+0000 7f6f537fe640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f5414fea0 0x7f6f541f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.370+0000 7f6f537fe640 1 -- 172.21.15.133:0/3929746305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f54159d80 msgr2=0x7f6f5414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:04.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.370+0000 7f6f537fe640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f54159d80 0x7f6f5414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:04.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.370+0000 7f6f537fe640 1 -- 172.21.15.133:0/3929746305 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480094d0 con 0x7f6f54156580 2024-01-19T04:31:04.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.374+0000 7f6f537fe640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f5414bac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6f4801f590 tx=0x7f6f4801ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:04.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.378+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480b0cf0 con 0x7f6f54156580 2024-01-19T04:31:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.378+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f480b0e50 con 0x7f6f54156580 2024-01-19T04:31:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.378+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480ba680 con 0x7f6f54156580 2024-01-19T04:31:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.378+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f541f4a40 con 0x7f6f54156580 2024-01-19T04:31:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.378+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f541f4480 con 0x7f6f54156580 2024-01-19T04:31:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.382+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5414df40 con 0x7f6f54156580 2024-01-19T04:31:04.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.842+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6f480ba7e0 con 0x7f6f54156580 2024-01-19T04:31:04.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.842+0000 7f6f50ff9640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6f40066550 0x7f6f40068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:04.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.842+0000 7f6f53fff640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6f40066550 0x7f6f40068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:04.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.842+0000 7f6f53fff640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6f40066550 0x7f6f40068a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098f0 tx=0x7f6f44006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:04.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.846+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f480f4010 con 0x7f6f54156580 2024-01-19T04:31:04.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:04.866+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6f480efc50 con 0x7f6f54156580 2024-01-19T04:31:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:05.162+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f5414df40 con 0x7f6f54156580 2024-01-19T04:31:07.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:31:07.905 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:31:09.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.254+0000 7f6f50ff9640 1 -- 172.21.15.133:0/3929746305 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12899 (secure 0 0 0) 0x7f6f5414df40 con 0x7f6f54156580 2024-01-19T04:31:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:09.256 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:30:51.169776+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:09.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6f40066550 msgr2=0x7f6f40068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6f40066550 0x7f6f40068a10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098f0 tx=0x7f6f44006f90 comp rx=0 tx=0).stop 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 msgr2=0x7f6f5414bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f5414bac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6f4801f590 tx=0x7f6f4801ba90 comp rx=0 tx=0).stop 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 shutdown_connections 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6f40066550 0x7f6f40068a10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f54159d80 0x7f6f5414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f54156580 0x7f6f5414bac0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 --2- 172.21.15.133:0/3929746305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f5414fea0 0x7f6f541f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 >> 172.21.15.133:0/3929746305 conn(0x7f6f540cbb60 msgr2=0x7f6f54071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 shutdown_connections 2024-01-19T04:31:09.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.258+0000 7f6f5a2c4640 1 -- 172.21.15.133:0/3929746305 wait complete. 2024-01-19T04:31:09.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:31:09.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:31:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d16d01640 1 Processor -- start 2024-01-19T04:31:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d16d01640 1 -- start start 2024-01-19T04:31:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d16d01640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d100c7ad0 0x7f1d100c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d16d01640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d100c6790 con 0x7f1d1015d310 2024-01-19T04:31:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d16d01640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d100c6a30 con 0x7f1d1015cf30 2024-01-19T04:31:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d16d01640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d100c4680 con 0x7f1d100c7ad0 2024-01-19T04:31:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d1529e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d1015d310 0x7f1d10153470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50052/0 (socket says 172.21.15.133:50052) 2024-01-19T04:31:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d1529e640 1 -- 172.21.15.133:0/2223485655 learned_addr learned my addr 172.21.15.133:0/2223485655 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.386+0000 7f1d0ffff640 1 --2- 172.21.15.133:0/2223485655 >> v2:172.21.15.156:3300/0 conn(0x7f1d100c7ad0 0x7f1d100c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:09.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.390+0000 7f1d0f7fe640 1 -- 172.21.15.133:0/2223485655 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065257673 0 0) 0x7f1d100c6790 con 0x7f1d1015d310 2024-01-19T04:31:09.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.390+0000 7f1d0f7fe640 1 -- 172.21.15.133:0/2223485655 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d00003530 con 0x7f1d1015d310 2024-01-19T04:31:09.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.394+0000 7f1d0ffff640 1 -- 172.21.15.133:0/2223485655 >> v1:172.21.15.156:6789/0 conn(0x7f1d1015cf30 legacy=0x7f1d10072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:09.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.394+0000 7f1d0ffff640 1 -- 172.21.15.133:0/2223485655 >> v1:172.21.15.133:6789/0 conn(0x7f1d1015d310 legacy=0x7f1d10153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:09.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.394+0000 7f1d0ffff640 1 -- 172.21.15.133:0/2223485655 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100c6d10 con 0x7f1d100c7ad0 2024-01-19T04:31:09.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:09.422+0000 7f1d0ffff640 1 --2- 172.21.15.133:0/2223485655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d100c7ad0 0x7f1d100c4140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0097c0 tx=0x7f1cfc01c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3774d5ff5148568a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:11.812 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2024-01-19T04:31:11.940 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-19T04:31:11.948 INFO:tasks.ceph.mds.d.smithi156.stdout:starting mds.d at 2024-01-19T04:31:11.952 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-19T04:31:11.988 INFO:tasks.ceph.mds.f.smithi156.stdout:starting mds.f at 2024-01-19T04:31:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d0f7fe640 1 -- 172.21.15.133:0/2223485655 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc0ab600 con 0x7f1d100c7ad0 2024-01-19T04:31:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d0f7fe640 1 -- 172.21.15.133:0/2223485655 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc0a7050 con 0x7f1d100c7ad0 2024-01-19T04:31:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d0f7fe640 1 -- 172.21.15.133:0/2223485655 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc0aba00 con 0x7f1d100c7ad0 2024-01-19T04:31:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 -- 172.21.15.133:0/2223485655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d100c7ad0 msgr2=0x7f1d100c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2223485655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d100c7ad0 0x7f1d100c4140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0097c0 tx=0x7f1cfc01c3b0 comp rx=0 tx=0).stop 2024-01-19T04:31:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 -- 172.21.15.133:0/2223485655 shutdown_connections 2024-01-19T04:31:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2223485655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d100c7ad0 0x7f1d100c4140 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 -- 172.21.15.133:0/2223485655 >> 172.21.15.133:0/2223485655 conn(0x7f1d1006fa20 msgr2=0x7f1d100c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 -- 172.21.15.133:0/2223485655 shutdown_connections 2024-01-19T04:31:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.106+0000 7f1d16d01640 1 -- 172.21.15.133:0/2223485655 wait complete. 2024-01-19T04:31:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 Processor -- start 2024-01-19T04:31:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 -- start start 2024-01-19T04:31:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 0x7f1d10150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1015cf30 0x7f1d10151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d1015d310 0x7f1d10158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d10150950 con 0x7f1d1015cf30 2024-01-19T04:31:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d101f5ba0 con 0x7f1d1015d310 2024-01-19T04:31:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.110+0000 7f1d16d01640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d101f6a00 con 0x7f1d100c7ad0 2024-01-19T04:31:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.114+0000 7f1d14a9d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 0x7f1d10150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.114+0000 7f1d14a9d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 0x7f1d10150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:49028/0 (socket says 172.21.15.133:49028) 2024-01-19T04:31:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.114+0000 7f1d14a9d640 1 -- 172.21.15.133:0/2499316607 learned_addr learned my addr 172.21.15.133:0/2499316607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:14.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.122+0000 7f1d14a9d640 1 -- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d1015d310 msgr2=0x7f1d10158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:14.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.122+0000 7f1d14a9d640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d1015d310 0x7f1d10158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:14.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.122+0000 7f1d14a9d640 1 -- 172.21.15.133:0/2499316607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1015cf30 msgr2=0x7f1d10151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:14.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.122+0000 7f1d14a9d640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1015cf30 0x7f1d10151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:14.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.122+0000 7f1d14a9d640 1 -- 172.21.15.133:0/2499316607 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009420 con 0x7f1d100c7ad0 2024-01-19T04:31:14.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.126+0000 7f1d14a9d640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 0x7f1d10150410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c480 tx=0x7f1d0400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.134+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04012830 con 0x7f1d100c7ad0 2024-01-19T04:31:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.134+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d040129b0 con 0x7f1d100c7ad0 2024-01-19T04:31:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.134+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04012d60 con 0x7f1d100c7ad0 2024-01-19T04:31:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.134+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d101f5df0 con 0x7f1d100c7ad0 2024-01-19T04:31:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.134+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d101f63b0 con 0x7f1d100c7ad0 2024-01-19T04:31:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.134+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d10072c40 con 0x7f1d100c7ad0 2024-01-19T04:31:14.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.426+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1d0401c460 con 0x7f1d100c7ad0 2024-01-19T04:31:14.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.426+0000 7f1d0d7fa640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1cf4066550 0x7f1cf4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:14.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.426+0000 7f1d0ffff640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1cf4066550 0x7f1cf4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:14.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.426+0000 7f1d0ffff640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1cf4066550 0x7f1cf4068a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0ad000 tx=0x7f1cfc004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.430+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d04055ef0 con 0x7f1d100c7ad0 2024-01-19T04:31:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.442+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1d04051b30 con 0x7f1d100c7ad0 2024-01-19T04:31:14.474 INFO:tasks.ceph.mds.e.smithi133.stdout:starting mds.e at 2024-01-19T04:31:14.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:14.618+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d10074340 con 0x7f1d100c7ad0 2024-01-19T04:31:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.182+0000 7f1d0d7fa640 1 -- 172.21.15.133:0/2499316607 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d04055150 con 0x7f1d100c7ad0 2024-01-19T04:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T04:31:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1cf4066550 msgr2=0x7f1cf4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1cf4066550 0x7f1cf4068a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0ad000 tx=0x7f1cfc004740 comp rx=0 tx=0).stop 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 msgr2=0x7f1d10150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 0x7f1d10150410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c480 tx=0x7f1d0400c940 comp rx=0 tx=0).stop 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 shutdown_connections 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1cf4066550 0x7f1cf4068a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d1015d310 0x7f1d10158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1015cf30 0x7f1d10151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 --2- 172.21.15.133:0/2499316607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d100c7ad0 0x7f1d10150410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 >> 172.21.15.133:0/2499316607 conn(0x7f1d1006fa20 msgr2=0x7f1d100c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 shutdown_connections 2024-01-19T04:31:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.186+0000 7f1d16d01640 1 -- 172.21.15.133:0/2499316607 wait complete. 2024-01-19T04:31:23.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:31:23.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 Processor -- start 2024-01-19T04:31:23.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 -- start start 2024-01-19T04:31:23.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6701563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6700c67e0 0x7fb6700c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6700c0e90 0x7fb6700c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67006f7c0 con 0x7fb6700c67e0 2024-01-19T04:31:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6700c2980 con 0x7fb6700c0e90 2024-01-19T04:31:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.326+0000 7fb676ebc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67006fa10 con 0x7fb670150610 2024-01-19T04:31:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.346+0000 7fb674c58640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6701563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.350+0000 7fb674c58640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6701563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:36954/0 (socket says 172.21.15.133:36954) 2024-01-19T04:31:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.350+0000 7fb674c58640 1 -- 172.21.15.133:0/930116405 learned_addr learned my addr 172.21.15.133:0/930116405 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.358+0000 7fb674c58640 1 -- 172.21.15.133:0/930116405 >> v2:172.21.15.156:3300/0 conn(0x7fb6700c0e90 msgr2=0x7fb6700c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.358+0000 7fb674c58640 1 --2- 172.21.15.133:0/930116405 >> v2:172.21.15.156:3300/0 conn(0x7fb6700c0e90 0x7fb6700c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.358+0000 7fb674c58640 1 -- 172.21.15.133:0/930116405 >> v2:172.21.15.133:3300/0 conn(0x7fb6700c67e0 msgr2=0x7fb6700c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.358+0000 7fb674c58640 1 --2- 172.21.15.133:0/930116405 >> v2:172.21.15.133:3300/0 conn(0x7fb6700c67e0 0x7fb6700c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.358+0000 7fb674c58640 1 -- 172.21.15.133:0/930116405 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670070570 con 0x7fb670150610 2024-01-19T04:31:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.366+0000 7fb674c58640 1 --2- 172.21.15.133:0/930116405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6701563f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb67006f390 tx=0x7fb66401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44dd076a82b0f185 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb66f7fe640 1 -- 172.21.15.133:0/930116405 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a89b0 con 0x7fb670150610 2024-01-19T04:31:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb66f7fe640 1 -- 172.21.15.133:0/930116405 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640a8b10 con 0x7fb670150610 2024-01-19T04:31:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb66f7fe640 1 -- 172.21.15.133:0/930116405 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a8ea0 con 0x7fb670150610 2024-01-19T04:31:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 -- 172.21.15.133:0/930116405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 msgr2=0x7fb6701563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 --2- 172.21.15.133:0/930116405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6701563f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb67006f390 tx=0x7fb66401ecf0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 -- 172.21.15.133:0/930116405 shutdown_connections 2024-01-19T04:31:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 --2- 172.21.15.133:0/930116405 >> v2:172.21.15.156:3300/0 conn(0x7fb6700c0e90 0x7fb6700c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 --2- 172.21.15.133:0/930116405 >> v2:172.21.15.133:3300/0 conn(0x7fb6700c67e0 0x7fb6700c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 --2- 172.21.15.133:0/930116405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6701563f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 -- 172.21.15.133:0/930116405 >> 172.21.15.133:0/930116405 conn(0x7fb67006de30 msgr2=0x7fb67006e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 -- 172.21.15.133:0/930116405 shutdown_connections 2024-01-19T04:31:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.490+0000 7fb676ebc640 1 -- 172.21.15.133:0/930116405 wait complete. 2024-01-19T04:31:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.494+0000 7fb676ebc640 1 Processor -- start 2024-01-19T04:31:23.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.494+0000 7fb676ebc640 1 -- start start 2024-01-19T04:31:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.498+0000 7fb676ebc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6700c0e90 0x7fb67013dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.498+0000 7fb676ebc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700c67e0 0x7fb6700c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.498+0000 7fb676ebc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6700c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.498+0000 7fb676ebc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670139810 con 0x7fb6700c67e0 2024-01-19T04:31:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.498+0000 7fb676ebc640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670139af0 con 0x7fb6700c0e90 2024-01-19T04:31:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.498+0000 7fb676ebc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb670139dd0 con 0x7fb670150610 2024-01-19T04:31:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.502+0000 7fb675459640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6700c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.502+0000 7fb675459640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6700c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:36962/0 (socket says 172.21.15.133:36962) 2024-01-19T04:31:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.502+0000 7fb675459640 1 -- 172.21.15.133:0/216647619 learned_addr learned my addr 172.21.15.133:0/216647619 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.506+0000 7fb675459640 1 -- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6700c0e90 msgr2=0x7fb67013dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.506+0000 7fb675459640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6700c0e90 0x7fb67013dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.506+0000 7fb675459640 1 -- 172.21.15.133:0/216647619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700c67e0 msgr2=0x7fb6700c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.506+0000 7fb675459640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700c67e0 0x7fb6700c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.506+0000 7fb675459640 1 -- 172.21.15.133:0/216647619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6640094d0 con 0x7fb670150610 2024-01-19T04:31:23.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.514+0000 7fb675459640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6700c43d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb66800b970 tx=0x7fb66800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.518+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800cb40 con 0x7fb670150610 2024-01-19T04:31:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.518+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800ccc0 con 0x7fb670150610 2024-01-19T04:31:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.518+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668014680 con 0x7fb670150610 2024-01-19T04:31:23.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.518+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6700c2f90 con 0x7fb670150610 2024-01-19T04:31:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.518+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67013a390 con 0x7fb670150610 2024-01-19T04:31:23.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.522+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6700c2df0 con 0x7fb670150610 2024-01-19T04:31:23.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.822+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb66801d3b0 con 0x7fb670150610 2024-01-19T04:31:23.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.822+0000 7fb66d7fa640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb654066550 0x7fb654068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:23.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.822+0000 7fb674c58640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb654066550 0x7fb654068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:23.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.826+0000 7fb674c58640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb654066550 0x7fb654068a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6640b2000 tx=0x7fb664004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.826+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb66800ce30 con 0x7fb670150610 2024-01-19T04:31:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:23.846+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb668051390 con 0x7fb670150610 2024-01-19T04:31:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.054+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6700c2df0 con 0x7fb670150610 2024-01-19T04:31:24.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.482+0000 7fb66d7fa640 1 -- 172.21.15.133:0/216647619 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fb6700c2df0 con 0x7fb670150610 2024-01-19T04:31:24.485 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:24.485 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-19T04:31:24.485 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 3 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb654066550 msgr2=0x7fb654068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb654066550 0x7fb654068a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6640b2000 tx=0x7fb664004740 comp rx=0 tx=0).stop 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 msgr2=0x7fb6700c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6700c43d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb66800b970 tx=0x7fb66800be30 comp rx=0 tx=0).stop 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 shutdown_connections 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb654066550 0x7fb654068a10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb670150610 0x7fb6700c43d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700c67e0 0x7fb6700c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 --2- 172.21.15.133:0/216647619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6700c0e90 0x7fb67013dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 >> 172.21.15.133:0/216647619 conn(0x7fb67006de30 msgr2=0x7fb67014de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 shutdown_connections 2024-01-19T04:31:24.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:24.486+0000 7fb676ebc640 1 -- 172.21.15.133:0/216647619 wait complete. 2024-01-19T04:31:26.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:31:26.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4adb3d4640 1 Processor -- start 2024-01-19T04:31:26.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4adb3d4640 1 -- start start 2024-01-19T04:31:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4adb3d4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ad40c75c0 0x7f4ad4159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4adb3d4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad4150280 con 0x7f4ad414fea0 2024-01-19T04:31:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4adb3d4640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad41590d0 con 0x7f4ad4159d80 2024-01-19T04:31:26.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4adb3d4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40c3270 con 0x7f4ad40c75c0 2024-01-19T04:31:26.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4ad9971640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4ad4159d80 0x7f4ad4071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:46872/0 (socket says 172.21.15.133:46872) 2024-01-19T04:31:26.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.646+0000 7f4ad9971640 1 -- 172.21.15.133:0/3442386188 learned_addr learned my addr 172.21.15.133:0/3442386188 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:26.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.714+0000 7f4ad896f640 1 --2- 172.21.15.133:0/3442386188 >> v2:172.21.15.133:3300/0 conn(0x7f4ad40c75c0 0x7f4ad4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:26.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.722+0000 7f4ad896f640 1 -- 172.21.15.133:0/3442386188 >> v1:172.21.15.156:6789/0 conn(0x7f4ad4159d80 legacy=0x7f4ad4071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:26.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.722+0000 7f4ad896f640 1 -- 172.21.15.133:0/3442386188 >> v1:172.21.15.133:6789/0 conn(0x7f4ad414fea0 legacy=0x7f4ad4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:26.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.722+0000 7f4ad896f640 1 -- 172.21.15.133:0/3442386188 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad41593b0 con 0x7f4ad40c75c0 2024-01-19T04:31:26.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.734+0000 7f4ad896f640 1 --2- 172.21.15.133:0/3442386188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad40c75c0 0x7f4ad4159840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400a960 tx=0x7f4ac4020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307ec873e53a0293 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4acbfff640 1 -- 172.21.15.133:0/3442386188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40a9e50 con 0x7f4ad40c75c0 2024-01-19T04:31:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4acbfff640 1 -- 172.21.15.133:0/3442386188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40b1440 con 0x7f4ad40c75c0 2024-01-19T04:31:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4acbfff640 1 -- 172.21.15.133:0/3442386188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40b17d0 con 0x7f4ad40c75c0 2024-01-19T04:31:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 -- 172.21.15.133:0/3442386188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad40c75c0 msgr2=0x7f4ad4159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/3442386188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad40c75c0 0x7f4ad4159840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400a960 tx=0x7f4ac4020040 comp rx=0 tx=0).stop 2024-01-19T04:31:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 -- 172.21.15.133:0/3442386188 shutdown_connections 2024-01-19T04:31:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/3442386188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad40c75c0 0x7f4ad4159840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 -- 172.21.15.133:0/3442386188 >> 172.21.15.133:0/3442386188 conn(0x7f4ad40cbb60 msgr2=0x7f4ad40c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 -- 172.21.15.133:0/3442386188 shutdown_connections 2024-01-19T04:31:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.742+0000 7f4adb3d4640 1 -- 172.21.15.133:0/3442386188 wait complete. 2024-01-19T04:31:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.746+0000 7f4adb3d4640 1 Processor -- start 2024-01-19T04:31:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.746+0000 7f4adb3d4640 1 -- start start 2024-01-19T04:31:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4adb3d4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ad40c75c0 0x7f4ad4145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4adb3d4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 0x7f4ad414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4adb3d4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad4159d80 0x7f4ad414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4adb3d4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4146030 con 0x7f4ad414fea0 2024-01-19T04:31:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4adb3d4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad41e0e40 con 0x7f4ad4159d80 2024-01-19T04:31:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4adb3d4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad414b9e0 con 0x7f4ad40c75c0 2024-01-19T04:31:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4ad896f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 0x7f4ad414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4ad896f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 0x7f4ad414e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45548/0 (socket says 172.21.15.133:45548) 2024-01-19T04:31:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.750+0000 7f4ad896f640 1 -- 172.21.15.133:0/1366247053 learned_addr learned my addr 172.21.15.133:0/1366247053 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.754+0000 7f4ad896f640 1 -- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ad40c75c0 msgr2=0x7f4ad4145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.754+0000 7f4ad896f640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ad40c75c0 0x7f4ad4145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.754+0000 7f4ad896f640 1 -- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad4159d80 msgr2=0x7f4ad414a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.754+0000 7f4ad896f640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad4159d80 0x7f4ad414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.754+0000 7f4ad896f640 1 -- 172.21.15.133:0/1366247053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac400a5c0 con 0x7f4ad414fea0 2024-01-19T04:31:26.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.758+0000 7f4ad896f640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 0x7f4ad414e7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ac401cc50 tx=0x7f4ac401cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:26.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.762+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40b2ea0 con 0x7f4ad414fea0 2024-01-19T04:31:26.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.762+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40af420 con 0x7f4ad414fea0 2024-01-19T04:31:26.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.762+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40af7f0 con 0x7f4ad414fea0 2024-01-19T04:31:26.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.762+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad414bcc0 con 0x7f4ad414fea0 2024-01-19T04:31:26.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.762+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad414e2c0 con 0x7f4ad414fea0 2024-01-19T04:31:26.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.762+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad414e120 con 0x7f4ad414fea0 2024-01-19T04:31:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.782+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4ac40b8050 con 0x7f4ad414fea0 2024-01-19T04:31:26.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.782+0000 7f4ac9ffb640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4ab8068760 0x7f4ab806ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.782+0000 7f4ad9170640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4ab8068760 0x7f4ab806ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:26.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:26.782+0000 7f4ad9170640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4ab8068760 0x7f4ab806ac20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000f70 tx=0x7f4ad00079e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:27.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.030+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ac40f3a00 con 0x7f4ad414fea0 2024-01-19T04:31:27.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.034+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4ac40ef640 con 0x7f4ad414fea0 2024-01-19T04:31:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.234+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ad414e120 con 0x7f4ad414fea0 2024-01-19T04:31:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.310+0000 7f4ac9ffb640 1 -- 172.21.15.133:0/1366247053 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+5286 (secure 0 0 0) 0x7f4ad414e120 con 0x7f4ad414fea0 2024-01-19T04:31:27.313 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:27.313 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2024-01-19T04:31:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 4 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4ab8068760 msgr2=0x7f4ab806ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4ab8068760 0x7f4ab806ac20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000f70 tx=0x7f4ad00079e0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 msgr2=0x7f4ad414e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 0x7f4ad414e7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ac401cc50 tx=0x7f4ac401cde0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 shutdown_connections 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4ab8068760 0x7f4ab806ac20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad4159d80 0x7f4ad414a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ad414fea0 0x7f4ad414e7e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 --2- 172.21.15.133:0/1366247053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ad40c75c0 0x7f4ad4145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 >> 172.21.15.133:0/1366247053 conn(0x7f4ad40cbb60 msgr2=0x7f4ad4144ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 shutdown_connections 2024-01-19T04:31:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.314+0000 7f4adb3d4640 1 -- 172.21.15.133:0/1366247053 wait complete. 2024-01-19T04:31:27.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.458+0000 7fb409b5d640 1 Processor -- start 2024-01-19T04:31:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.458+0000 7fb409b5d640 1 -- start start 2024-01-19T04:31:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb409b5d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb404151600 0x7fb40415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb409b5d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4041519e0 0x7fb4040c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb409b5d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb404158390 con 0x7fb40406f350 2024-01-19T04:31:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb409b5d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40415b0e0 con 0x7fb404151600 2024-01-19T04:31:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb409b5d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404157b70 con 0x7fb4041519e0 2024-01-19T04:31:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb4037fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb404151600 0x7fb40415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb403fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb40406f350 0x7fb404157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37120/0 (socket says 172.21.15.133:37120) 2024-01-19T04:31:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb403fff640 1 -- 172.21.15.133:0/627089383 learned_addr learned my addr 172.21.15.133:0/627089383 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.462+0000 7fb402ffd640 1 --2- 172.21.15.133:0/627089383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4041519e0 0x7fb4040c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.466+0000 7fb4037fe640 1 -- 172.21.15.133:0/627089383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4041519e0 msgr2=0x7fb4040c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.466+0000 7fb4037fe640 1 --2- 172.21.15.133:0/627089383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4041519e0 0x7fb4040c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.466+0000 7fb4037fe640 1 -- 172.21.15.133:0/627089383 >> v1:172.21.15.133:6789/0 conn(0x7fb40406f350 legacy=0x7fb404157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:27.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.466+0000 7fb4037fe640 1 -- 172.21.15.133:0/627089383 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404157dd0 con 0x7fb404151600 2024-01-19T04:31:27.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.470+0000 7fb4037fe640 1 --2- 172.21.15.133:0/627089383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb404151600 0x7fb40415b570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0097c0 tx=0x7fb3fc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eade507e27778179 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:27.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb4027fc640 1 -- 172.21.15.133:0/627089383 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0ab600 con 0x7fb404151600 2024-01-19T04:31:27.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb4027fc640 1 -- 172.21.15.133:0/627089383 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0a7050 con 0x7fb404151600 2024-01-19T04:31:27.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb4027fc640 1 -- 172.21.15.133:0/627089383 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0ab980 con 0x7fb404151600 2024-01-19T04:31:27.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 -- 172.21.15.133:0/627089383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb404151600 msgr2=0x7fb40415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 --2- 172.21.15.133:0/627089383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb404151600 0x7fb40415b570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0097c0 tx=0x7fb3fc01c480 comp rx=0 tx=0).stop 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 -- 172.21.15.133:0/627089383 shutdown_connections 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 --2- 172.21.15.133:0/627089383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4041519e0 0x7fb4040c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 --2- 172.21.15.133:0/627089383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb404151600 0x7fb40415b570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 -- 172.21.15.133:0/627089383 >> 172.21.15.133:0/627089383 conn(0x7fb40406d590 msgr2=0x7fb404066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 -- 172.21.15.133:0/627089383 shutdown_connections 2024-01-19T04:31:27.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.474+0000 7fb409b5d640 1 -- 172.21.15.133:0/627089383 wait complete. 2024-01-19T04:31:27.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 Processor -- start 2024-01-19T04:31:27.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 -- start start 2024-01-19T04:31:27.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 0x7fb4041f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:27.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4040c4650 0x7fb4041431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:27.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404140c30 0x7fb404144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:27.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404142d50 con 0x7fb40406f350 2024-01-19T04:31:27.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404067ac0 con 0x7fb4040c4650 2024-01-19T04:31:27.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb409b5d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404142a20 con 0x7fb404140c30 2024-01-19T04:31:27.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 0x7fb4041f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:27.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 0x7fb4041f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45566/0 (socket says 172.21.15.133:45566) 2024-01-19T04:31:27.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb4037fe640 1 -- 172.21.15.133:0/1140731023 learned_addr learned my addr 172.21.15.133:0/1140731023 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:27.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb403fff640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404140c30 0x7fb404144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:27.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.478+0000 7fb402ffd640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4040c4650 0x7fb4041431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:27.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.482+0000 7fb4037fe640 1 -- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404140c30 msgr2=0x7fb404144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.482+0000 7fb4037fe640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404140c30 0x7fb404144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.482+0000 7fb4037fe640 1 -- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4040c4650 msgr2=0x7fb4041431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.482+0000 7fb4037fe640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4040c4650 0x7fb4041431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:27.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.482+0000 7fb4037fe640 1 -- 172.21.15.133:0/1140731023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009420 con 0x7fb40406f350 2024-01-19T04:31:27.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.486+0000 7fb4037fe640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 0x7fb4041f3230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc01a0b0 tx=0x7fb3fc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.490+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0b4400 con 0x7fb40406f350 2024-01-19T04:31:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.490+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0b4560 con 0x7fb40406f350 2024-01-19T04:31:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.490+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040c30d0 con 0x7fb40406f350 2024-01-19T04:31:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.490+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0b4910 con 0x7fb40406f350 2024-01-19T04:31:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.490+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040c2df0 con 0x7fb40406f350 2024-01-19T04:31:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.490+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb404142880 con 0x7fb40406f350 2024-01-19T04:31:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.510+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb3fc0b2040 con 0x7fb40406f350 2024-01-19T04:31:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.510+0000 7fb3fbfff640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb3e4066550 0x7fb3e4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.510+0000 7fb402ffd640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb3e4066550 0x7fb3e4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:27.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.510+0000 7fb402ffd640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb3e4066550 0x7fb3e4068a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb40414bde0 tx=0x7fb3ec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.778+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3fc0ef6d0 con 0x7fb40406f350 2024-01-19T04:31:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.778+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb3fc0eba10 con 0x7fb40406f350 2024-01-19T04:31:27.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.950+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb404142880 con 0x7fb40406f350 2024-01-19T04:31:28.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:27.998+0000 7fb3fbfff640 1 -- 172.21.15.133:0/1140731023 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12899 (secure 0 0 0) 0x7fb404142880 con 0x7fb40406f350 2024-01-19T04:31:28.000 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:28.000 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:30:51.169776+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb3e4066550 msgr2=0x7fb3e4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb3e4066550 0x7fb3e4068a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb40414bde0 tx=0x7fb3ec009190 comp rx=0 tx=0).stop 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 msgr2=0x7fb4041f3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 0x7fb4041f3230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc01a0b0 tx=0x7fb3fc019220 comp rx=0 tx=0).stop 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 shutdown_connections 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb3e4066550 0x7fb3e4068a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4040c4650 0x7fb4041431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404140c30 0x7fb404144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 --2- 172.21.15.133:0/1140731023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb40406f350 0x7fb4041f3230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 >> 172.21.15.133:0/1140731023 conn(0x7fb40406d590 msgr2=0x7fb404066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 shutdown_connections 2024-01-19T04:31:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.002+0000 7fb409b5d640 1 -- 172.21.15.133:0/1140731023 wait complete. 2024-01-19T04:31:28.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:31:28.023 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:31:28.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.150+0000 7f327341f640 1 Processor -- start 2024-01-19T04:31:28.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.150+0000 7f327341f640 1 -- start start 2024-01-19T04:31:28.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f327341f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f326c159560 0x7f326c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:28.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f327341f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c153cf0 con 0x7f326c153910 2024-01-19T04:31:28.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f327341f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c15a4f0 con 0x7f326c06bf70 2024-01-19T04:31:28.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f327341f640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c06baa0 con 0x7f326c159560 2024-01-19T04:31:28.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f32719bc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f326c159560 0x7f326c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:28.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f32719bc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f326c159560 0x7f326c1599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:51332/0 (socket says 172.21.15.133:51332) 2024-01-19T04:31:28.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.154+0000 7f32719bc640 1 -- 172.21.15.133:0/2529449420 learned_addr learned my addr 172.21.15.133:0/2529449420 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.162+0000 7f32719bc640 1 -- 172.21.15.133:0/2529449420 >> v1:172.21.15.156:6789/0 conn(0x7f326c06bf70 legacy=0x7f326c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.162+0000 7f32719bc640 1 -- 172.21.15.133:0/2529449420 >> v1:172.21.15.133:6789/0 conn(0x7f326c153910 legacy=0x7f326c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.162+0000 7f32719bc640 1 -- 172.21.15.133:0/2529449420 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c15cc60 con 0x7f326c159560 2024-01-19T04:31:28.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.170+0000 7f32719bc640 1 --2- 172.21.15.133:0/2529449420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c159560 0x7f326c1599d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3264009e50 tx=0x7f326401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d0191e4301e8625 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f325ffff640 1 -- 172.21.15.133:0/2529449420 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640a56e0 con 0x7f326c159560 2024-01-19T04:31:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f325ffff640 1 -- 172.21.15.133:0/2529449420 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32640a5840 con 0x7f326c159560 2024-01-19T04:31:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f325ffff640 1 -- 172.21.15.133:0/2529449420 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640a5bd0 con 0x7f326c159560 2024-01-19T04:31:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 -- 172.21.15.133:0/2529449420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c159560 msgr2=0x7f326c1599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 --2- 172.21.15.133:0/2529449420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c159560 0x7f326c1599d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3264009e50 tx=0x7f326401c910 comp rx=0 tx=0).stop 2024-01-19T04:31:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 -- 172.21.15.133:0/2529449420 shutdown_connections 2024-01-19T04:31:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 --2- 172.21.15.133:0/2529449420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c159560 0x7f326c1599d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 -- 172.21.15.133:0/2529449420 >> 172.21.15.133:0/2529449420 conn(0x7f326c06a660 msgr2=0x7f326c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 -- 172.21.15.133:0/2529449420 shutdown_connections 2024-01-19T04:31:28.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.286+0000 7f327341f640 1 -- 172.21.15.133:0/2529449420 wait complete. 2024-01-19T04:31:28.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 Processor -- start 2024-01-19T04:31:28.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 -- start start 2024-01-19T04:31:28.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 0x7f326c0ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:28.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c153910 0x7f326c147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:28.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f326c159560 0x7f326c1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:28.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0ad4f0 con 0x7f326c159560 2024-01-19T04:31:28.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0cb0c0 con 0x7f326c153910 2024-01-19T04:31:28.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.290+0000 7f327341f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0ad700 con 0x7f326c06bf70 2024-01-19T04:31:28.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.294+0000 7f32711bb640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 0x7f326c0ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:28.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.294+0000 7f32711bb640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 0x7f326c0ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:36986/0 (socket says 172.21.15.133:36986) 2024-01-19T04:31:28.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.294+0000 7f32711bb640 1 -- 172.21.15.133:0/3439580037 learned_addr learned my addr 172.21.15.133:0/3439580037 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:28.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.294+0000 7f32719bc640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f326c159560 0x7f326c1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:28.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.294+0000 7f32709ba640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c153910 0x7f326c147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.302+0000 7f32711bb640 1 -- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c153910 msgr2=0x7f326c147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.302+0000 7f32711bb640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c153910 0x7f326c147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.302+0000 7f32711bb640 1 -- 172.21.15.133:0/3439580037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f326c159560 msgr2=0x7f326c1480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.302+0000 7f32711bb640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f326c159560 0x7f326c1480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.302+0000 7f32711bb640 1 -- 172.21.15.133:0/3439580037 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264009b30 con 0x7f326c06bf70 2024-01-19T04:31:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.310+0000 7f32711bb640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 0x7f326c0ae250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f326000b3e0 tx=0x7f326000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:28.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.406+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260011830 con 0x7f326c06bf70 2024-01-19T04:31:28.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.406+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600119b0 con 0x7f326c06bf70 2024-01-19T04:31:28.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.406+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260011d60 con 0x7f326c06bf70 2024-01-19T04:31:28.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.406+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c0cbc20 con 0x7f326c06bf70 2024-01-19T04:31:28.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.406+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c0cc1e0 con 0x7f326c06bf70 2024-01-19T04:31:28.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.406+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c0cc400 con 0x7f326c06bf70 2024-01-19T04:31:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.674+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f326001a400 con 0x7f326c06bf70 2024-01-19T04:31:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.674+0000 7f325dffb640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3250066550 0x7f3250068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.674+0000 7f32709ba640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3250066550 0x7f3250068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:28.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.674+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3260055bd0 con 0x7f326c06bf70 2024-01-19T04:31:28.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.678+0000 7f32709ba640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3250066550 0x7f3250068a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3268001770 tx=0x7f3268009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:28.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.690+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3260051810 con 0x7f326c06bf70 2024-01-19T04:31:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.866+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f326c0ad840 con 0x7f326c06bf70 2024-01-19T04:31:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f325dffb640 1 -- 172.21.15.133:0/3439580037 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f326c0ad840 con 0x7f326c06bf70 2024-01-19T04:31:28.873 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T04:31:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3250066550 msgr2=0x7f3250068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3250066550 0x7f3250068a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3268001770 tx=0x7f3268009040 comp rx=0 tx=0).stop 2024-01-19T04:31:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 msgr2=0x7f326c0ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 0x7f326c0ae250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f326000b3e0 tx=0x7f326000b8a0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 shutdown_connections 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3250066550 0x7f3250068a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326c153910 0x7f326c147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f326c159560 0x7f326c1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 --2- 172.21.15.133:0/3439580037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326c06bf70 0x7f326c0ae250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 >> 172.21.15.133:0/3439580037 conn(0x7f326c06a660 msgr2=0x7f326c14d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 shutdown_connections 2024-01-19T04:31:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:28.874+0000 7f327341f640 1 -- 172.21.15.133:0/3439580037 wait complete. 2024-01-19T04:31:28.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:31:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.010+0000 7f6a54bb2640 1 Processor -- start 2024-01-19T04:31:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.010+0000 7f6a54bb2640 1 -- start start 2024-01-19T04:31:29.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a54bb2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a50151600 0x7f6a5015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a54bb2640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a500c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a54bb2640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a50158390 con 0x7f6a501519e0 2024-01-19T04:31:29.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a54bb2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5015b0e0 con 0x7f6a50151600 2024-01-19T04:31:29.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a54bb2640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50157b70 con 0x7f6a5006f350 2024-01-19T04:31:29.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a4e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a50151600 0x7f6a5015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a4e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a50151600 0x7f6a5015b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45594/0 (socket says 172.21.15.133:45594) 2024-01-19T04:31:29.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a4e59c640 1 -- 172.21.15.133:0/215029624 learned_addr learned my addr 172.21.15.133:0/215029624 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.014+0000 7f6a4ed9d640 1 --2- 172.21.15.133:0/215029624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a500c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.018+0000 7f6a4e59c640 1 -- 172.21.15.133:0/215029624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 msgr2=0x7f6a500c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.018+0000 7f6a4e59c640 1 --2- 172.21.15.133:0/215029624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a500c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.018+0000 7f6a4e59c640 1 -- 172.21.15.133:0/215029624 >> v1:172.21.15.156:6789/0 conn(0x7f6a501519e0 legacy=0x7f6a50157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.018+0000 7f6a4e59c640 1 -- 172.21.15.133:0/215029624 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50157dd0 con 0x7f6a50151600 2024-01-19T04:31:29.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.022+0000 7f6a4e59c640 1 --2- 172.21.15.133:0/215029624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a5015b570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009870 tx=0x7f6a4001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef93ce82e36a82c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.026+0000 7f6a4d59a640 1 -- 172.21.15.133:0/215029624 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400ac600 con 0x7f6a50151600 2024-01-19T04:31:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.026+0000 7f6a4d59a640 1 -- 172.21.15.133:0/215029624 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a400a8050 con 0x7f6a50151600 2024-01-19T04:31:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.026+0000 7f6a4d59a640 1 -- 172.21.15.133:0/215029624 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400ac980 con 0x7f6a50151600 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.026+0000 7f6a54bb2640 1 -- 172.21.15.133:0/215029624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 msgr2=0x7f6a5015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.026+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/215029624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a5015b570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009870 tx=0x7f6a4001c4b0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- 172.21.15.133:0/215029624 shutdown_connections 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/215029624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a500c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/215029624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a5015b570 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- 172.21.15.133:0/215029624 >> 172.21.15.133:0/215029624 conn(0x7f6a5006d590 msgr2=0x7f6a50066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- 172.21.15.133:0/215029624 shutdown_connections 2024-01-19T04:31:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- 172.21.15.133:0/215029624 wait complete. 2024-01-19T04:31:29.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 Processor -- start 2024-01-19T04:31:29.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- start start 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a50157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a50156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a50159950 0x7f6a50159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50155730 con 0x7f6a50151600 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a501578b0 con 0x7f6a50159950 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a54bb2640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5015a320 con 0x7f6a5006f350 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a4dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a50156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a4dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a50156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45600/0 (socket says 172.21.15.133:45600) 2024-01-19T04:31:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a4dd9b640 1 -- 172.21.15.133:0/2338138627 learned_addr learned my addr 172.21.15.133:0/2338138627 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a4e59c640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a50157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.030+0000 7f6a4ed9d640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a50159950 0x7f6a50159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.034+0000 7f6a4dd9b640 1 -- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 msgr2=0x7f6a50157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.034+0000 7f6a4dd9b640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a50157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.034+0000 7f6a4dd9b640 1 -- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a50159950 msgr2=0x7f6a50159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.034+0000 7f6a4dd9b640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a50159950 0x7f6a50159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.034+0000 7f6a4dd9b640 1 -- 172.21.15.133:0/2338138627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400094d0 con 0x7f6a50151600 2024-01-19T04:31:29.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.038+0000 7f6a4dd9b640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a50156820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c480 tx=0x7f6a4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.042+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440052d0 con 0x7f6a50151600 2024-01-19T04:31:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.042+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44005430 con 0x7f6a50151600 2024-01-19T04:31:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.042+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44007260 con 0x7f6a50151600 2024-01-19T04:31:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.042+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a501f0190 con 0x7f6a50151600 2024-01-19T04:31:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.042+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a501f0730 con 0x7f6a50151600 2024-01-19T04:31:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.042+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a50159750 con 0x7f6a50151600 2024-01-19T04:31:29.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.318+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6a440073c0 con 0x7f6a50151600 2024-01-19T04:31:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.322+0000 7f6a3effd640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6a3006a960 0x7f6a3006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.322+0000 7f6a4e59c640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6a3006a960 0x7f6a3006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.322+0000 7f6a4e59c640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6a3006a960 0x7f6a3006ce20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a400ae000 tx=0x7f6a40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.358+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a44007670 con 0x7f6a50151600 2024-01-19T04:31:29.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.358+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6a44051800 con 0x7f6a50151600 2024-01-19T04:31:29.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.534+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6a50071fa0 con 0x7f6a50151600 2024-01-19T04:31:29.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.550+0000 7f6a3effd640 1 -- 172.21.15.133:0/2338138627 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6a44054e20 con 0x7f6a50151600 2024-01-19T04:31:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:29.550 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-19T04:31:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-19T04:31:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-19T04:31:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2024-01-19T04:31:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-19T04:31:29.551 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-19T04:31:29.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6a3006a960 msgr2=0x7f6a3006ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6a3006a960 0x7f6a3006ce20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a400ae000 tx=0x7f6a40008040 comp rx=0 tx=0).stop 2024-01-19T04:31:29.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 msgr2=0x7f6a50156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a50156820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c480 tx=0x7f6a4400c940 comp rx=0 tx=0).stop 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 shutdown_connections 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6a3006a960 0x7f6a3006ce20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a50159950 0x7f6a50159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a50151600 0x7f6a50156820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 --2- 172.21.15.133:0/2338138627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a5006f350 0x7f6a50157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 >> 172.21.15.133:0/2338138627 conn(0x7f6a5006d590 msgr2=0x7f6a500717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 shutdown_connections 2024-01-19T04:31:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.554+0000 7f6a54bb2640 1 -- 172.21.15.133:0/2338138627 wait complete. 2024-01-19T04:31:29.571 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T04:31:29.571 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T04:31:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc6d50640 1 Processor -- start 2024-01-19T04:31:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc6d50640 1 -- start start 2024-01-19T04:31:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc6d50640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00bffd0 0x7fefc0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc6d50640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc00722a0 con 0x7fefc00cb370 2024-01-19T04:31:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc6d50640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc0072580 con 0x7fefc00cb750 2024-01-19T04:31:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc6d50640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0072860 con 0x7fefc00bffd0 2024-01-19T04:31:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc4aec640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefc00cb370 0x7fefc0071a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37140/0 (socket says 172.21.15.133:37140) 2024-01-19T04:31:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.694+0000 7fefc4aec640 1 -- 172.21.15.133:0/645552293 learned_addr learned my addr 172.21.15.133:0/645552293 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.698+0000 7fefbffff640 1 --2- 172.21.15.133:0/645552293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00bffd0 0x7fefc0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.702+0000 7fefbf7fe640 1 -- 172.21.15.133:0/645552293 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955932168 0 0) 0x7fefc00722a0 con 0x7fefc00cb370 2024-01-19T04:31:29.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.702+0000 7fefbf7fe640 1 -- 172.21.15.133:0/645552293 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa8003530 con 0x7fefc00cb370 2024-01-19T04:31:29.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.702+0000 7fefbffff640 1 -- 172.21.15.133:0/645552293 >> v1:172.21.15.156:6789/0 conn(0x7fefc00cb750 legacy=0x7fefc014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.702+0000 7fefbffff640 1 -- 172.21.15.133:0/645552293 >> v1:172.21.15.133:6789/0 conn(0x7fefc00cb370 legacy=0x7fefc0071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.702+0000 7fefbffff640 1 -- 172.21.15.133:0/645552293 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc0072b40 con 0x7fefc00bffd0 2024-01-19T04:31:29.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.710+0000 7fefbffff640 1 --2- 172.21.15.133:0/645552293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00bffd0 0x7fefc0159f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fefb40097f0 tx=0x7fefb401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ee0b3cfe8f8d20b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefbf7fe640 1 -- 172.21.15.133:0/645552293 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40a89b0 con 0x7fefc00bffd0 2024-01-19T04:31:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefbf7fe640 1 -- 172.21.15.133:0/645552293 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb40a8b10 con 0x7fefc00bffd0 2024-01-19T04:31:29.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefbf7fe640 1 -- 172.21.15.133:0/645552293 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40a8ea0 con 0x7fefc00bffd0 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- 172.21.15.133:0/645552293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00bffd0 msgr2=0x7fefc0159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 --2- 172.21.15.133:0/645552293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00bffd0 0x7fefc0159f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fefb40097f0 tx=0x7fefb401ecb0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- 172.21.15.133:0/645552293 shutdown_connections 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 --2- 172.21.15.133:0/645552293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00bffd0 0x7fefc0159f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- 172.21.15.133:0/645552293 >> 172.21.15.133:0/645552293 conn(0x7fefc006d590 msgr2=0x7fefc0066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- 172.21.15.133:0/645552293 shutdown_connections 2024-01-19T04:31:29.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- 172.21.15.133:0/645552293 wait complete. 2024-01-19T04:31:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 Processor -- start 2024-01-19T04:31:29.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- start start 2024-01-19T04:31:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefc00bffd0 0x7fefc0146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 0x7fefc0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00cb750 0x7fefc01ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0153be0 con 0x7fefc00cb370 2024-01-19T04:31:29.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0146ec0 con 0x7fefc00bffd0 2024-01-19T04:31:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefc6d50640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0152e60 con 0x7fefc00cb750 2024-01-19T04:31:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.718+0000 7fefbffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 0x7fefc0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.722+0000 7fefbffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 0x7fefc0150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45614/0 (socket says 172.21.15.133:45614) 2024-01-19T04:31:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.722+0000 7fefbffff640 1 -- 172.21.15.133:0/1744563237 learned_addr learned my addr 172.21.15.133:0/1744563237 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.722+0000 7fefc4aec640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefc00bffd0 0x7fefc0146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.722+0000 7fefc52ed640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00cb750 0x7fefc01ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.726+0000 7fefbffff640 1 -- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00cb750 msgr2=0x7fefc01ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.726+0000 7fefbffff640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00cb750 0x7fefc01ecc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.726+0000 7fefbffff640 1 -- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefc00bffd0 msgr2=0x7fefc0146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.726+0000 7fefbffff640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefc00bffd0 0x7fefc0146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:29.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.726+0000 7fefbffff640 1 -- 172.21.15.133:0/1744563237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4009420 con 0x7fefc00cb370 2024-01-19T04:31:29.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.726+0000 7fefbffff640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 0x7fefc0150c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefb401b8c0 tx=0x7fefb401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:29.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.730+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40b9630 con 0x7fefc00cb370 2024-01-19T04:31:29.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.730+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc0151440 con 0x7fefc00cb370 2024-01-19T04:31:29.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.730+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc01533e0 con 0x7fefc00cb370 2024-01-19T04:31:29.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:29.730+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc0074340 con 0x7fefc00cb370 2024-01-19T04:31:30.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.014+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb40b9790 con 0x7fefc00cb370 2024-01-19T04:31:30.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.014+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40b9b00 con 0x7fefc00cb370 2024-01-19T04:31:30.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.014+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fefb40b7040 con 0x7fefc00cb370 2024-01-19T04:31:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.018+0000 7fefbd7fa640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fefac066530 0x7fefac0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.018+0000 7fefc4aec640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fefac066530 0x7fefac0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:30.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.018+0000 7fefc4aec640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fefac066530 0x7fefac0689f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefb00011f0 tx=0x7fefb0007d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:30.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.046+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fefb40f3860 con 0x7fefc00cb370 2024-01-19T04:31:30.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.046+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fefb40efba0 con 0x7fefc00cb370 2024-01-19T04:31:30.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.218+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fefc00c63e0 con 0x7fefc00cb370 2024-01-19T04:31:30.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.610+0000 7fefbd7fa640 1 -- 172.21.15.133:0/1744563237 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fefb40b5030 con 0x7fefc00cb370 2024-01-19T04:31:30.612 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-19T04:31:30.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fefac066530 msgr2=0x7fefac0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:30.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fefac066530 0x7fefac0689f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefb00011f0 tx=0x7fefb0007d40 comp rx=0 tx=0).stop 2024-01-19T04:31:30.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 msgr2=0x7fefc0150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:30.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 0x7fefc0150c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefb401b8c0 tx=0x7fefb401ba50 comp rx=0 tx=0).stop 2024-01-19T04:31:30.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 shutdown_connections 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fefac066530 0x7fefac0689f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefc00cb750 0x7fefc01ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc00cb370 0x7fefc0150c20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 --2- 172.21.15.133:0/1744563237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefc00bffd0 0x7fefc0146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 >> 172.21.15.133:0/1744563237 conn(0x7fefc006d590 msgr2=0x7fefc014c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 shutdown_connections 2024-01-19T04:31:30.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.614+0000 7fefc6d50640 1 -- 172.21.15.133:0/1744563237 wait complete. 2024-01-19T04:31:30.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-19T04:31:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.770+0000 7f874b59e640 1 Processor -- start 2024-01-19T04:31:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.770+0000 7f874b59e640 1 -- start start 2024-01-19T04:31:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.774+0000 7f874b59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87440cb8c0 0x7f87440cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.774+0000 7f874b59e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f874415a0d0 0x7f874406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.774+0000 7f874b59e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87440c3e00 con 0x7f874406c8e0 2024-01-19T04:31:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.774+0000 7f874b59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440cc1e0 con 0x7f87440cb8c0 2024-01-19T04:31:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.774+0000 7f874b59e640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440caa50 con 0x7f874415a0d0 2024-01-19T04:31:30.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.802+0000 7f874933a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87440cb8c0 0x7f87440cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:30.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.810+0000 7f874933a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87440cb8c0 0x7f87440cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45624/0 (socket says 172.21.15.133:45624) 2024-01-19T04:31:30.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.810+0000 7f874933a640 1 -- 172.21.15.133:0/1726941525 learned_addr learned my addr 172.21.15.133:0/1726941525 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:30.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.814+0000 7f874933a640 1 -- 172.21.15.133:0/1726941525 >> v2:172.21.15.156:3300/0 conn(0x7f874415a0d0 msgr2=0x7f874406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:30.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.814+0000 7f874933a640 1 --2- 172.21.15.133:0/1726941525 >> v2:172.21.15.156:3300/0 conn(0x7f874415a0d0 0x7f874406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.814+0000 7f874933a640 1 -- 172.21.15.133:0/1726941525 >> v1:172.21.15.156:6789/0 conn(0x7f874406c8e0 legacy=0x7f874415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:30.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.814+0000 7f874933a640 1 -- 172.21.15.133:0/1726941525 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440cad10 con 0x7f87440cb8c0 2024-01-19T04:31:30.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.818+0000 7f874933a640 1 --2- 172.21.15.133:0/1726941525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87440cbca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87440cc4e0 tx=0x7f874001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a11bc84dc9a52e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:30.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f873bfff640 1 -- 172.21.15.133:0/1726941525 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400a89b0 con 0x7f87440cb8c0 2024-01-19T04:31:30.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f873bfff640 1 -- 172.21.15.133:0/1726941525 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400a8b10 con 0x7f87440cb8c0 2024-01-19T04:31:30.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f873bfff640 1 -- 172.21.15.133:0/1726941525 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400a8ea0 con 0x7f87440cb8c0 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 -- 172.21.15.133:0/1726941525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 msgr2=0x7f87440cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 --2- 172.21.15.133:0/1726941525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87440cbca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87440cc4e0 tx=0x7f874001ecb0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 -- 172.21.15.133:0/1726941525 shutdown_connections 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 --2- 172.21.15.133:0/1726941525 >> v2:172.21.15.156:3300/0 conn(0x7f874415a0d0 0x7f874406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 --2- 172.21.15.133:0/1726941525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87440cbca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 -- 172.21.15.133:0/1726941525 >> 172.21.15.133:0/1726941525 conn(0x7f874408b600 msgr2=0x7f8744071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 -- 172.21.15.133:0/1726941525 shutdown_connections 2024-01-19T04:31:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.830+0000 7f874b59e640 1 -- 172.21.15.133:0/1726941525 wait complete. 2024-01-19T04:31:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 Processor -- start 2024-01-19T04:31:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 -- start start 2024-01-19T04:31:30.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f874406c8e0 0x7f87441f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:30.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87441563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:30.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f874415a0d0 0x7f87440c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:30.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87441559e0 con 0x7f87440cb8c0 2024-01-19T04:31:30.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8744155f30 con 0x7f874415a0d0 2024-01-19T04:31:30.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f874b59e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87440ce1d0 con 0x7f874406c8e0 2024-01-19T04:31:30.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f8748b39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87441563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f8748b39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87441563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45626/0 (socket says 172.21.15.133:45626) 2024-01-19T04:31:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.834+0000 7f8748b39640 1 -- 172.21.15.133:0/1404457975 learned_addr learned my addr 172.21.15.133:0/1404457975 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:30.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.846+0000 7f8748b39640 1 -- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f874406c8e0 msgr2=0x7f87441f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:30.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.846+0000 7f8748b39640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f874406c8e0 0x7f87441f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.846+0000 7f8748b39640 1 -- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f874415a0d0 msgr2=0x7f87440c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:30.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.846+0000 7f8748b39640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f874415a0d0 0x7f87440c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:30.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.846+0000 7f8748b39640 1 -- 172.21.15.133:0/1404457975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400094d0 con 0x7f87440cb8c0 2024-01-19T04:31:30.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.850+0000 7f8748b39640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87441563c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f873400b580 tx=0x7f873400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.914+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734010870 con 0x7f87440cb8c0 2024-01-19T04:31:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.914+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340109f0 con 0x7f87440cb8c0 2024-01-19T04:31:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.914+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87440ce4b0 con 0x7f87440cb8c0 2024-01-19T04:31:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.914+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734010da0 con 0x7f87440cb8c0 2024-01-19T04:31:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.914+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8744156ba0 con 0x7f87440cb8c0 2024-01-19T04:31:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:30.918+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87440ce6d0 con 0x7f87440cb8c0 2024-01-19T04:31:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.226+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8734023480 con 0x7f87440cb8c0 2024-01-19T04:31:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.230+0000 7f8739ffb640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8728066550 0x7f8728068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.230+0000 7f874933a640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8728066550 0x7f8728068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:31.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.230+0000 7f874933a640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8728066550 0x7f8728068a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87400b2000 tx=0x7f8740004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.242+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8734055a10 con 0x7f87440cb8c0 2024-01-19T04:31:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.242+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8734051650 con 0x7f87440cb8c0 2024-01-19T04:31:31.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.426+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f8744074340 con 0x7f87440cb8c0 2024-01-19T04:31:31.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.666+0000 7f8739ffb640 1 -- 172.21.15.133:0/1404457975 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f873401e0d0 con 0x7f87440cb8c0 2024-01-19T04:31:31.668 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-19T04:31:31.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8728066550 msgr2=0x7f8728068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:31.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8728066550 0x7f8728068a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87400b2000 tx=0x7f8740004740 comp rx=0 tx=0).stop 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 msgr2=0x7f87441563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87441563c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f873400b580 tx=0x7f873400ba40 comp rx=0 tx=0).stop 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 shutdown_connections 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8728066550 0x7f8728068a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f874415a0d0 0x7f87440c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87440cb8c0 0x7f87441563c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 --2- 172.21.15.133:0/1404457975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f874406c8e0 0x7f87441f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 >> 172.21.15.133:0/1404457975 conn(0x7f874408b600 msgr2=0x7f87440b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 shutdown_connections 2024-01-19T04:31:31.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.670+0000 7f874b59e640 1 -- 172.21.15.133:0/1404457975 wait complete. 2024-01-19T04:31:31.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T04:31:31.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.838+0000 7f03ae6f6640 1 Processor -- start 2024-01-19T04:31:31.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.838+0000 7f03ae6f6640 1 -- start start 2024-01-19T04:31:31.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.838+0000 7f03ae6f6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a815a600 0x7f03a80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.838+0000 7f03ae6f6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a815a170 con 0x7f03a80c9920 2024-01-19T04:31:31.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.838+0000 7f03ae6f6640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80b27a0 con 0x7f03a80cf9e0 2024-01-19T04:31:31.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.838+0000 7f03ae6f6640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8159950 con 0x7f03a815a600 2024-01-19T04:31:31.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.842+0000 7f03a7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f03a80c9920 0x7f03a80b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37152/0 (socket says 172.21.15.133:37152) 2024-01-19T04:31:31.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.842+0000 7f03a7fff640 1 -- 172.21.15.133:0/3309411035 learned_addr learned my addr 172.21.15.133:0/3309411035 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:31.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.846+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471889322 0 0) 0x7f03a815a170 con 0x7f03a80c9920 2024-01-19T04:31:31.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.846+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0394003530 con 0x7f03a80c9920 2024-01-19T04:31:31.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3481529941 0 0) 0x7f0394003530 con 0x7f03a80c9920 2024-01-19T04:31:31.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a815a600 msgr2=0x7f03a80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:31.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a815a600 0x7f03a80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 >> v1:172.21.15.156:6789/0 conn(0x7f03a80cf9e0 legacy=0x7f03a8164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:31.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80ca680 con 0x7f03a80c9920 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f03a0001680 con 0x7f03a80c9920 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 >> v1:172.21.15.133:6789/0 conn(0x7f03a80c9920 legacy=0x7f03a80b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0394003a20 0x7f0394003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03940047d0 0x7f0394004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a815a600 0x7f039400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940055d0 con 0x7f03940047d0 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039400bed0 con 0x7f0394003a20 2024-01-19T04:31:31.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039400c010 con 0x7f03a815a600 2024-01-19T04:31:31.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.850+0000 7f03a77fe640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03940047d0 0x7f0394004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:31.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.854+0000 7f03a77fe640 1 -- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a815a600 msgr2=0x7f039400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:31.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.854+0000 7f03a77fe640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a815a600 0x7f039400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.854+0000 7f03a77fe640 1 -- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0394003a20 msgr2=0x7f0394003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:31.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.854+0000 7f03a77fe640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0394003a20 0x7f0394003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.854+0000 7f03a77fe640 1 -- 172.21.15.133:0/3309411035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394003530 con 0x7f03940047d0 2024-01-19T04:31:31.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.858+0000 7f03a77fe640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03940047d0 0x7f0394004c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0390009890 tx=0x7f039001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64480958599c6a8b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:31.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900ab600 con 0x7f03940047d0 2024-01-19T04:31:31.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03900a7050 con 0x7f03940047d0 2024-01-19T04:31:31.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03a6ffd640 1 -- 172.21.15.133:0/3309411035 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900aba00 con 0x7f03940047d0 2024-01-19T04:31:31.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03ae6f6640 1 -- 172.21.15.133:0/3309411035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03940047d0 msgr2=0x7f0394004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:31.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/3309411035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03940047d0 0x7f0394004c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0390009890 tx=0x7f039001c3a0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03acc93640 1 -- 172.21.15.133:0/3309411035 reap_dead start 2024-01-19T04:31:31.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03ae6f6640 1 -- 172.21.15.133:0/3309411035 shutdown_connections 2024-01-19T04:31:31.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03ae6f6640 1 -- 172.21.15.133:0/3309411035 >> 172.21.15.133:0/3309411035 conn(0x7f03a808afa0 msgr2=0x7f03a808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:31.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03ae6f6640 1 -- 172.21.15.133:0/3309411035 shutdown_connections 2024-01-19T04:31:31.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.862+0000 7f03ae6f6640 1 -- 172.21.15.133:0/3309411035 wait complete. 2024-01-19T04:31:31.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 Processor -- start 2024-01-19T04:31:31.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 -- start start 2024-01-19T04:31:31.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8154850 0x7f03a815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 0x7f03a8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8156210 0x7f03a81f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81f0140 con 0x7f03a8154c30 2024-01-19T04:31:31.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8156690 con 0x7f03a8154850 2024-01-19T04:31:31.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03ae6f6640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81ef200 con 0x7f03a8156210 2024-01-19T04:31:31.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03a77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 0x7f03a8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:31.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03a77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 0x7f03a8155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45632/0 (socket says 172.21.15.133:45632) 2024-01-19T04:31:31.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.866+0000 7f03a77fe640 1 -- 172.21.15.133:0/2764430432 learned_addr learned my addr 172.21.15.133:0/2764430432 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:31.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.870+0000 7f03a77fe640 1 -- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8156210 msgr2=0x7f03a81f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:31.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.870+0000 7f03a77fe640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8156210 0x7f03a81f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.870+0000 7f03a77fe640 1 -- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8154850 msgr2=0x7f03a815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:31.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.870+0000 7f03a77fe640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8154850 0x7f03a815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:31.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.870+0000 7f03a77fe640 1 -- 172.21.15.133:0/2764430432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a81ef4c0 con 0x7f03a8154c30 2024-01-19T04:31:31.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.874+0000 7f03a77fe640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 0x7f03a8155cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f039001c1d0 tx=0x7f0394005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.878+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900b4400 con 0x7f03a8154c30 2024-01-19T04:31:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.878+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03900b4560 con 0x7f03a8154c30 2024-01-19T04:31:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.878+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a81ef7a0 con 0x7f03a8154c30 2024-01-19T04:31:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.878+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900b48d0 con 0x7f03a8154c30 2024-01-19T04:31:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.878+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a81efd60 con 0x7f03a8154c30 2024-01-19T04:31:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.878+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a806d7f0 con 0x7f03a8154c30 2024-01-19T04:31:31.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.898+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f03900b2040 con 0x7f03a8154c30 2024-01-19T04:31:31.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.898+0000 7f03a4ff9640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0388066500 0x7f03880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:31.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.898+0000 7f03a7fff640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0388066500 0x7f03880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:31.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.902+0000 7f03a7fff640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0388066500 0x7f03880689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f03a000af40 tx=0x7f03a0001550 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:31.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:31.902+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f03900ef8a0 con 0x7f03a8154c30 2024-01-19T04:31:32.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:32.250+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f03900eb4e0 con 0x7f03a8154c30 2024-01-19T04:31:32.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:32.466+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f03a81efef0 con 0x7f03a8154c30 2024-01-19T04:31:34.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.038+0000 7f03a4ff9640 1 -- 172.21.15.133:0/2764430432 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v5) v1 ==== 172+0+0 (secure 0 0 0) 0x7f03900b0070 con 0x7f03a8154c30 2024-01-19T04:31:34.038 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 2 and data pool 3 2024-01-19T04:31:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0388066500 msgr2=0x7f03880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0388066500 0x7f03880689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f03a000af40 tx=0x7f03a0001550 comp rx=0 tx=0).stop 2024-01-19T04:31:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 msgr2=0x7f03a8155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 0x7f03a8155cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f039001c1d0 tx=0x7f0394005800 comp rx=0 tx=0).stop 2024-01-19T04:31:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 shutdown_connections 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0388066500 0x7f03880689c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8156210 0x7f03a81f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a8154c30 0x7f03a8155cd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 --2- 172.21.15.133:0/2764430432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8154850 0x7f03a815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 >> 172.21.15.133:0/2764430432 conn(0x7f03a808afa0 msgr2=0x7f03a80b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 shutdown_connections 2024-01-19T04:31:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.042+0000 7f03ae6f6640 1 -- 172.21.15.133:0/2764430432 wait complete. 2024-01-19T04:31:34.062 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-19T04:31:34.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-19T04:31:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 Processor -- start 2024-01-19T04:31:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 -- start start 2024-01-19T04:31:34.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa580070e00 0x7fa58015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa58015d9a0 0x7fa580164110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580159c60 con 0x7fa580159790 2024-01-19T04:31:34.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58015a780 con 0x7fa58015d9a0 2024-01-19T04:31:34.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa587ce1640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58015d040 con 0x7fa580070e00 2024-01-19T04:31:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa58527c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa580159790 0x7fa5801535c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42014/0 (socket says 172.21.15.133:42014) 2024-01-19T04:31:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.190+0000 7fa58527c640 1 -- 172.21.15.133:0/343279794 learned_addr learned my addr 172.21.15.133:0/343279794 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.194+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767181246 0 0) 0x7fa580159c60 con 0x7fa580159790 2024-01-19T04:31:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.194+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa56c003530 con 0x7fa580159790 2024-01-19T04:31:34.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1540892594 0 0) 0x7fa56c003530 con 0x7fa580159790 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa580070e00 msgr2=0x7fa58015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa580070e00 0x7fa58015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 >> v2:172.21.15.156:3300/0 conn(0x7fa58015d9a0 msgr2=0x7fa580164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 --2- 172.21.15.133:0/343279794 >> v2:172.21.15.156:3300/0 conn(0x7fa58015d9a0 0x7fa580164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58006b770 con 0x7fa580159790 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fa570001680 con 0x7fa580159790 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 >> v1:172.21.15.133:6789/0 conn(0x7fa580159790 legacy=0x7fa5801535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa56c003980 0x7fa56c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa580070e00 0x7fa56c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c004e30 0x7fa56c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58015a780 con 0x7fa56c004e30 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58015d040 con 0x7fa56c003980 2024-01-19T04:31:34.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.202+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0055f0 con 0x7fa580070e00 2024-01-19T04:31:34.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.206+0000 7fa58627e640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c004e30 0x7fa56c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:34.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.206+0000 7fa58627e640 1 -- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa580070e00 msgr2=0x7fa56c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:34.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.206+0000 7fa58627e640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa580070e00 0x7fa56c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.206+0000 7fa58627e640 1 -- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa56c003980 msgr2=0x7fa56c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:34.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.206+0000 7fa58627e640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa56c003980 0x7fa56c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.206+0000 7fa58627e640 1 -- 172.21.15.133:0/343279794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c003530 con 0x7fa56c004e30 2024-01-19T04:31:34.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.210+0000 7fa58627e640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c004e30 0x7fa56c00b990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5800ca010 tx=0x7fa57c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3e3870f6dfea53 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:34.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.214+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0a5c00 con 0x7fa56c004e30 2024-01-19T04:31:34.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.214+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c0a5d80 con 0x7fa56c004e30 2024-01-19T04:31:34.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.214+0000 7fa584a7b640 1 -- 172.21.15.133:0/343279794 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0ad680 con 0x7fa56c004e30 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 -- 172.21.15.133:0/343279794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c004e30 msgr2=0x7fa56c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 --2- 172.21.15.133:0/343279794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c004e30 0x7fa56c00b990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5800ca010 tx=0x7fa57c01cbf0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa58627e640 1 -- 172.21.15.133:0/343279794 reap_dead start 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 -- 172.21.15.133:0/343279794 shutdown_connections 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 -- 172.21.15.133:0/343279794 >> 172.21.15.133:0/343279794 conn(0x7fa580066b70 msgr2=0x7fa58006ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 -- 172.21.15.133:0/343279794 shutdown_connections 2024-01-19T04:31:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 -- 172.21.15.133:0/343279794 wait complete. 2024-01-19T04:31:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 Processor -- start 2024-01-19T04:31:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.218+0000 7fa587ce1640 1 -- start start 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa587ce1640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800cb430 0x7fa58014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa587ce1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800c27f0 0x7fa58014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa587ce1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 0x7fa5801f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa587ce1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580154630 con 0x7fa5800cb810 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa587ce1640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5801548f0 con 0x7fa5800cb430 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa587ce1640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa580154bd0 con 0x7fa5800c27f0 2024-01-19T04:31:34.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa58627e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 0x7fa5801f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:34.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa58627e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 0x7fa5801f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59604/0 (socket says 172.21.15.133:59604) 2024-01-19T04:31:34.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.222+0000 7fa58627e640 1 -- 172.21.15.133:0/1224898962 learned_addr learned my addr 172.21.15.133:0/1224898962 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:34.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.226+0000 7fa58627e640 1 -- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800c27f0 msgr2=0x7fa58014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:34.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.226+0000 7fa58627e640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800c27f0 0x7fa58014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.226+0000 7fa58627e640 1 -- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800cb430 msgr2=0x7fa58014e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:34.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.226+0000 7fa58627e640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800cb430 0x7fa58014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:34.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.226+0000 7fa58627e640 1 -- 172.21.15.133:0/1224898962 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580154eb0 con 0x7fa5800cb810 2024-01-19T04:31:34.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.230+0000 7fa58627e640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 0x7fa5801f05e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa57c01c660 tx=0x7fa56c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:34.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.234+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c004450 con 0x7fa5800cb810 2024-01-19T04:31:34.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.234+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c0045b0 con 0x7fa5800cb810 2024-01-19T04:31:34.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.234+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580155190 con 0x7fa5800cb810 2024-01-19T04:31:34.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.234+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0092f0 con 0x7fa5800cb810 2024-01-19T04:31:34.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.234+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5801564d0 con 0x7fa5800cb810 2024-01-19T04:31:34.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.238+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5801556b0 con 0x7fa5800cb810 2024-01-19T04:31:34.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.258+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa57c0b4070 con 0x7fa5800cb810 2024-01-19T04:31:34.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.258+0000 7fa5767fc640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa564066580 0x7fa564068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:34.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.258+0000 7fa585a7d640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa564066580 0x7fa564068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:34.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.258+0000 7fa585a7d640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa564066580 0x7fa564068a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5780096b0 tx=0x7fa578006cb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:34.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.534+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa57c0ef410 con 0x7fa5800cb810 2024-01-19T04:31:34.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.534+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa57c0eb050 con 0x7fa5800cb810 2024-01-19T04:31:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:34.766+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa580155320 con 0x7fa5800cb810 2024-01-19T04:31:35.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.774+0000 7fa5767fc640 1 -- 172.21.15.133:0/1224898962 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa57c003e60 con 0x7fa5800cb810 2024-01-19T04:31:35.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa564066580 msgr2=0x7fa564068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa564066580 0x7fa564068a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5780096b0 tx=0x7fa578006cb0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 msgr2=0x7fa5801f05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 0x7fa5801f05e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa57c01c660 tx=0x7fa56c005800 comp rx=0 tx=0).stop 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 shutdown_connections 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa564066580 0x7fa564068a40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb810 0x7fa5801f05e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800c27f0 0x7fa58014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 --2- 172.21.15.133:0/1224898962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800cb430 0x7fa58014e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 >> 172.21.15.133:0/1224898962 conn(0x7fa5800c2410 msgr2=0x7fa58006ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 shutdown_connections 2024-01-19T04:31:35.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.778+0000 7fa587ce1640 1 -- 172.21.15.133:0/1224898962 wait complete. 2024-01-19T04:31:35.802 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:31:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.934+0000 7f60db6fd640 1 Processor -- start 2024-01-19T04:31:35.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.934+0000 7f60db6fd640 1 -- start start 2024-01-19T04:31:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60db6fd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60d40c2e00 0x7f60d40c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60db6fd640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d4156a20 con 0x7f60d406e460 2024-01-19T04:31:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60db6fd640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d4156d00 con 0x7f60d4150500 2024-01-19T04:31:35.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60db6fd640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d4156fe0 con 0x7f60d40c2e00 2024-01-19T04:31:35.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60d8c98640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60d40c2e00 0x7f60d40c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:35.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60d8c98640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60d40c2e00 0x7f60d40c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:57870/0 (socket says 172.21.15.133:57870) 2024-01-19T04:31:35.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.938+0000 7f60d8c98640 1 -- 172.21.15.133:0/4081516761 learned_addr learned my addr 172.21.15.133:0/4081516761 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:35.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.946+0000 7f60d8c98640 1 -- 172.21.15.133:0/4081516761 >> v1:172.21.15.156:6789/0 conn(0x7f60d4150500 legacy=0x7f60d4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:35.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.946+0000 7f60d8c98640 1 -- 172.21.15.133:0/4081516761 >> v1:172.21.15.133:6789/0 conn(0x7f60d406e460 legacy=0x7f60d415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:35.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.946+0000 7f60d8c98640 1 -- 172.21.15.133:0/4081516761 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d41599e0 con 0x7f60d40c2e00 2024-01-19T04:31:35.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.950+0000 7f60d8c98640 1 --2- 172.21.15.133:0/4081516761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 0x7f60d40c5f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009870 tx=0x7f60c401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f28e5074f415da server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:35.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60cbfff640 1 -- 172.21.15.133:0/4081516761 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40a89b0 con 0x7f60d40c2e00 2024-01-19T04:31:35.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60cbfff640 1 -- 172.21.15.133:0/4081516761 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c40a8b10 con 0x7f60d40c2e00 2024-01-19T04:31:35.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60cbfff640 1 -- 172.21.15.133:0/4081516761 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40a8ea0 con 0x7f60d40c2e00 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- 172.21.15.133:0/4081516761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 msgr2=0x7f60d40c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4081516761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 0x7f60d40c5f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009870 tx=0x7f60c401ecb0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- 172.21.15.133:0/4081516761 shutdown_connections 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4081516761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 0x7f60d40c5f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- 172.21.15.133:0/4081516761 >> 172.21.15.133:0/4081516761 conn(0x7f60d406b770 msgr2=0x7f60d406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- 172.21.15.133:0/4081516761 shutdown_connections 2024-01-19T04:31:35.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- 172.21.15.133:0/4081516761 wait complete. 2024-01-19T04:31:35.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 Processor -- start 2024-01-19T04:31:35.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- start start 2024-01-19T04:31:35.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 0x7f60d41532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:35.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 0x7f60d4150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:35.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60d4150500 0x7f60d41510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:35.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4152a40 con 0x7f60d406e460 2024-01-19T04:31:35.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41f40a0 con 0x7f60d40c2e00 2024-01-19T04:31:35.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60db6fd640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41e43b0 con 0x7f60d4150500 2024-01-19T04:31:35.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.966+0000 7f60d9499640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 0x7f60d41532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:35.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 0x7f60d41532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59610/0 (socket says 172.21.15.133:59610) 2024-01-19T04:31:35.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 -- 172.21.15.133:0/4188873390 learned_addr learned my addr 172.21.15.133:0/4188873390 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:35.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9c9a640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60d4150500 0x7f60d41510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 -- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60d4150500 msgr2=0x7f60d41510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60d4150500 0x7f60d41510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 -- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 msgr2=0x7f60d4150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 0x7f60d4150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.970+0000 7f60d9499640 1 -- 172.21.15.133:0/4188873390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40094d0 con 0x7f60d406e460 2024-01-19T04:31:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.974+0000 7f60d9499640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 0x7f60d41532a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60d000b410 tx=0x7f60d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.978+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0004020 con 0x7f60d406e460 2024-01-19T04:31:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.978+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0004180 con 0x7f60d406e460 2024-01-19T04:31:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.978+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011630 con 0x7f60d406e460 2024-01-19T04:31:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.978+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d40c9350 con 0x7f60d406e460 2024-01-19T04:31:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.978+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d41f3490 con 0x7f60d406e460 2024-01-19T04:31:35.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:35.978+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d4074340 con 0x7f60d406e460 2024-01-19T04:31:36.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.002+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60d0011790 con 0x7f60d406e460 2024-01-19T04:31:36.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.002+0000 7f60c9ffb640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f60b8066550 0x7f60b8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:36.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.002+0000 7f60d8c98640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f60b8066550 0x7f60b8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:36.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.002+0000 7f60d8c98640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f60b8066550 0x7f60b8068a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f60c40b2000 tx=0x7f60c4004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:36.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.002+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f60d00559a0 con 0x7f60d406e460 2024-01-19T04:31:36.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.258+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f60d00515e0 con 0x7f60d406e460 2024-01-19T04:31:36.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:36.442+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60d40c60c0 con 0x7f60d406e460 2024-01-19T04:31:37.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:31:37.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:31:38.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.658+0000 7f60c9ffb640 1 -- 172.21.15.133:0/4188873390 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f60d0015100 con 0x7f60d406e460 2024-01-19T04:31:38.659 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data_ec' created 2024-01-19T04:31:38.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f60b8066550 msgr2=0x7f60b8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:38.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f60b8066550 0x7f60b8068a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f60c40b2000 tx=0x7f60c4004740 comp rx=0 tx=0).stop 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 msgr2=0x7f60d41532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 0x7f60d41532a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60d000b410 tx=0x7f60d000b8d0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 shutdown_connections 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f60b8066550 0x7f60b8068a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60d40c2e00 0x7f60d4150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60d4150500 0x7f60d41510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 --2- 172.21.15.133:0/4188873390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60d406e460 0x7f60d41532a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 >> 172.21.15.133:0/4188873390 conn(0x7f60d406b770 msgr2=0x7f60d415a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:38.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 shutdown_connections 2024-01-19T04:31:38.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.662+0000 7f60db6fd640 1 -- 172.21.15.133:0/4188873390 wait complete. 2024-01-19T04:31:38.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-19T04:31:38.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.818+0000 7fe48c9d5640 1 Processor -- start 2024-01-19T04:31:38.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.818+0000 7fe48c9d5640 1 -- start start 2024-01-19T04:31:38.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.818+0000 7fe48c9d5640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4880c54a0 0x7fe4880c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.818+0000 7fe48c9d5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880c7420 con 0x7fe488151930 2024-01-19T04:31:38.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.818+0000 7fe48c9d5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880cbae0 con 0x7fe4880c5880 2024-01-19T04:31:38.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.818+0000 7fe48c9d5640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880ccaf0 con 0x7fe4880c54a0 2024-01-19T04:31:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.834+0000 7fe486d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe488151930 0x7fe48815a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42040/0 (socket says 172.21.15.133:42040) 2024-01-19T04:31:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.834+0000 7fe486d9d640 1 -- 172.21.15.133:0/239729199 learned_addr learned my addr 172.21.15.133:0/239729199 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:38.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.838+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489012626 0 0) 0x7fe4880c7420 con 0x7fe488151930 2024-01-19T04:31:38.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.838+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe470003530 con 0x7fe488151930 2024-01-19T04:31:38.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3203951234 0 0) 0x7fe470003530 con 0x7fe488151930 2024-01-19T04:31:38.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 >> v2:172.21.15.156:3300/0 conn(0x7fe4880c54a0 msgr2=0x7fe4880c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:38.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 --2- 172.21.15.133:0/239729199 >> v2:172.21.15.156:3300/0 conn(0x7fe4880c54a0 0x7fe4880c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 >> v1:172.21.15.156:6789/0 conn(0x7fe4880c5880 legacy=0x7fe488151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:38.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48815b6f0 con 0x7fe488151930 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fe480001a00 con 0x7fe488151930 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 >> v1:172.21.15.133:6789/0 conn(0x7fe488151930 legacy=0x7fe48815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700039d0 0x7fe470003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4700047d0 0x7fe470004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe470005340 0x7fe47000b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880ccaf0 con 0x7fe4700047d0 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47000c290 con 0x7fe470005340 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.842+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47000c450 con 0x7fe4700039d0 2024-01-19T04:31:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.846+0000 7fe485d9b640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4700047d0 0x7fe470004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.850+0000 7fe485d9b640 1 -- 172.21.15.133:0/239729199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700039d0 msgr2=0x7fe470003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.850+0000 7fe485d9b640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700039d0 0x7fe470003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.850+0000 7fe485d9b640 1 -- 172.21.15.133:0/239729199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe470005340 msgr2=0x7fe47000b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.850+0000 7fe485d9b640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe470005340 0x7fe47000b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.850+0000 7fe485d9b640 1 -- 172.21.15.133:0/239729199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470003530 con 0x7fe4700047d0 2024-01-19T04:31:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.850+0000 7fe486d9d640 1 -- 172.21.15.133:0/239729199 reap_dead start 2024-01-19T04:31:38.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.854+0000 7fe485d9b640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4700047d0 0x7fe470004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe47c001650 tx=0x7fe47c01c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cb549c3714f303 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c005270 con 0x7fe4700047d0 2024-01-19T04:31:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c0a7070 con 0x7fe4700047d0 2024-01-19T04:31:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48559a640 1 -- 172.21.15.133:0/239729199 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c003860 con 0x7fe4700047d0 2024-01-19T04:31:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 -- 172.21.15.133:0/239729199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4700047d0 msgr2=0x7fe470004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4700047d0 0x7fe470004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe47c001650 tx=0x7fe47c01c2b0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 -- 172.21.15.133:0/239729199 shutdown_connections 2024-01-19T04:31:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/239729199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4700047d0 0x7fe470004c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 -- 172.21.15.133:0/239729199 >> 172.21.15.133:0/239729199 conn(0x7fe48806fb60 msgr2=0x7fe48806ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 -- 172.21.15.133:0/239729199 shutdown_connections 2024-01-19T04:31:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.862+0000 7fe48c9d5640 1 -- 172.21.15.133:0/239729199 wait complete. 2024-01-19T04:31:38.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 Processor -- start 2024-01-19T04:31:38.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 -- start start 2024-01-19T04:31:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700047d0 0x7fe4881466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe488149580 0x7fe4881499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 0x7fe4881f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4881522e0 con 0x7fe4881f36e0 2024-01-19T04:31:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488152de0 con 0x7fe488149580 2024-01-19T04:31:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe48c9d5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4881490f0 con 0x7fe4700047d0 2024-01-19T04:31:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe486d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 0x7fe4881f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe486d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 0x7fe4881f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59622/0 (socket says 172.21.15.133:59622) 2024-01-19T04:31:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.866+0000 7fe486d9d640 1 -- 172.21.15.133:0/201646609 learned_addr learned my addr 172.21.15.133:0/201646609 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:38.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.870+0000 7fe486d9d640 1 -- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700047d0 msgr2=0x7fe4881466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:38.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.870+0000 7fe486d9d640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700047d0 0x7fe4881466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.870+0000 7fe486d9d640 1 -- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe488149580 msgr2=0x7fe4881499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:38.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.870+0000 7fe486d9d640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe488149580 0x7fe4881499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:38.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.870+0000 7fe486d9d640 1 -- 172.21.15.133:0/201646609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488146c30 con 0x7fe4881f36e0 2024-01-19T04:31:38.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.874+0000 7fe486d9d640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 0x7fe4881f3b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe48000c840 tx=0x7fe48000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:38.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.878+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000a5e0 con 0x7fe4881f36e0 2024-01-19T04:31:38.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.878+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000a740 con 0x7fe4881f36e0 2024-01-19T04:31:38.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.878+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe488153100 con 0x7fe4881f36e0 2024-01-19T04:31:38.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.878+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000aaf0 con 0x7fe4881f36e0 2024-01-19T04:31:38.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.878+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe488149f00 con 0x7fe4881f36e0 2024-01-19T04:31:38.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:38.878+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe488074340 con 0x7fe4881f36e0 2024-01-19T04:31:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.158+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe48000ac50 con 0x7fe4881f36e0 2024-01-19T04:31:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.158+0000 7fe476ffd640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe468066550 0x7fe468068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:39.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.158+0000 7fe48659c640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe468066550 0x7fe468068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:39.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.158+0000 7fe48659c640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe468066550 0x7fe468068a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4780096b0 tx=0x7fe478006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:39.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.198+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fe4800552e0 con 0x7fe4881f36e0 2024-01-19T04:31:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.222+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe480050f20 con 0x7fe4881f36e0 2024-01-19T04:31:39.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.390+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fe4880c9140 con 0x7fe4881f36e0 2024-01-19T04:31:39.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.630+0000 7fe476ffd640 1 -- 172.21.15.133:0/201646609 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe480054540 con 0x7fe4881f36e0 2024-01-19T04:31:39.632 INFO:teuthology.orchestra.run.smithi133.stderr:set pool 4 allow_ec_overwrites to true 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe468066550 msgr2=0x7fe468068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe468066550 0x7fe468068a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4780096b0 tx=0x7fe478006ca0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 msgr2=0x7fe4881f3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 0x7fe4881f3b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe48000c840 tx=0x7fe48000cd00 comp rx=0 tx=0).stop 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 shutdown_connections 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe468066550 0x7fe468068a10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe488149580 0x7fe4881499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4881f36e0 0x7fe4881f3b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 --2- 172.21.15.133:0/201646609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4700047d0 0x7fe4881466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 >> 172.21.15.133:0/201646609 conn(0x7fe48806fb60 msgr2=0x7fe4880cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:39.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 shutdown_connections 2024-01-19T04:31:39.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.634+0000 7fe48c9d5640 1 -- 172.21.15.133:0/201646609 wait complete. 2024-01-19T04:31:39.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-19T04:31:39.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.786+0000 7f5bfdb6d640 1 Processor -- start 2024-01-19T04:31:39.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.786+0000 7f5bfdb6d640 1 -- start start 2024-01-19T04:31:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bfdb6d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5bf81503c0 0x7f5bf80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bfdb6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bf80c7cd0 0x7f5bf80c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bfdb6d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf8156760 con 0x7f5bf8072760 2024-01-19T04:31:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bfdb6d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf8157300 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bfdb6d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf81507a0 con 0x7f5bf81503c0 2024-01-19T04:31:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bf7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bf80c7cd0 0x7f5bf80c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bf6ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5bf8072760 0x7f5bf8156bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42054/0 (socket says 172.21.15.133:42054) 2024-01-19T04:31:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.790+0000 7f5bf6ffd640 1 -- 172.21.15.133:0/2223886878 learned_addr learned my addr 172.21.15.133:0/2223886878 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.794+0000 7f5bf7fff640 1 -- 172.21.15.133:0/2223886878 >> v2:172.21.15.156:3300/0 conn(0x7f5bf81503c0 msgr2=0x7f5bf80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.794+0000 7f5bf7fff640 1 --2- 172.21.15.133:0/2223886878 >> v2:172.21.15.156:3300/0 conn(0x7f5bf81503c0 0x7f5bf80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.794+0000 7f5bf7fff640 1 -- 172.21.15.133:0/2223886878 >> v1:172.21.15.133:6789/0 conn(0x7f5bf8072760 legacy=0x7f5bf8156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.794+0000 7f5bf7fff640 1 -- 172.21.15.133:0/2223886878 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8071a10 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.798+0000 7f5bf7fff640 1 --2- 172.21.15.133:0/2223886878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80c8100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8071690 tx=0x7f5bf001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738c4bea316a3a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bf67fc640 1 -- 172.21.15.133:0/2223886878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00b0440 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bf67fc640 1 -- 172.21.15.133:0/2223886878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf00b05a0 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bf67fc640 1 -- 172.21.15.133:0/2223886878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00b0930 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/2223886878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 msgr2=0x7f5bf80c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/2223886878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80c8100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8071690 tx=0x7f5bf001f0f0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/2223886878 shutdown_connections 2024-01-19T04:31:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/2223886878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80c8100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/2223886878 >> v2:172.21.15.156:3300/0 conn(0x7f5bf81503c0 0x7f5bf80c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/2223886878 >> 172.21.15.133:0/2223886878 conn(0x7f5bf806aa60 msgr2=0x7f5bf806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/2223886878 shutdown_connections 2024-01-19T04:31:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.802+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/2223886878 wait complete. 2024-01-19T04:31:39.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 Processor -- start 2024-01-19T04:31:39.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 -- start start 2024-01-19T04:31:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bf8072760 0x7f5bf8143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bf81503c0 0x7f5bf8145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80c9fe0 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8153dc0 con 0x7f5bf8072760 2024-01-19T04:31:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.806+0000 7f5bfdb6d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81443e0 con 0x7f5bf81503c0 2024-01-19T04:31:39.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.834+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:39.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.834+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59632/0 (socket says 172.21.15.133:59632) 2024-01-19T04:31:39.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.834+0000 7f5bf6ffd640 1 -- 172.21.15.133:0/1427728752 learned_addr learned my addr 172.21.15.133:0/1427728752 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:39.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.850+0000 7f5bf77fe640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bf8072760 0x7f5bf8143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.858+0000 7f5bf7fff640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bf81503c0 0x7f5bf8145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.862+0000 7f5bf6ffd640 1 -- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bf81503c0 msgr2=0x7f5bf8145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.862+0000 7f5bf6ffd640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bf81503c0 0x7f5bf8145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.862+0000 7f5bf6ffd640 1 -- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bf8072760 msgr2=0x7f5bf8143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.862+0000 7f5bf6ffd640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bf8072760 0x7f5bf8143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.862+0000 7f5bf6ffd640 1 -- 172.21.15.133:0/1427728752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0009a70 con 0x7f5bf80c7cd0 2024-01-19T04:31:39.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:39.894+0000 7f5bf6ffd640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80ca430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c420 tx=0x7f5be800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:40.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.038+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8005cf0 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.038+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8005e50 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.038+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80072f0 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.038+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf81446c0 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.038+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf8142b00 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.042+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8074340 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.402+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5be8007450 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.402+0000 7f5bdffff640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5be4066550 0x7f5be4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:40.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.406+0000 7f5bf77fe640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5be4066550 0x7f5be4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:40.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.406+0000 7f5bf77fe640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5be4066550 0x7f5be4068a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0098f0 tx=0x7f5bec006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:40.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.442+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f5be8054850 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.442+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5be8050b90 con 0x7f5bf80c7cd0 2024-01-19T04:31:40.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:40.754+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f5bf80c6320 con 0x7f5bf80c7cd0 2024-01-19T04:31:42.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.062+0000 7f5bdffff640 1 -- 172.21.15.133:0/1427728752 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v8) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5be8017030 con 0x7f5bf80c7cd0 2024-01-19T04:31:42.062 INFO:teuthology.orchestra.run.smithi133.stderr:added data pool 4 to fsmap 2024-01-19T04:31:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5be4066550 msgr2=0x7f5be4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5be4066550 0x7f5be4068a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0098f0 tx=0x7f5bec006f90 comp rx=0 tx=0).stop 2024-01-19T04:31:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 msgr2=0x7f5bf80ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80ca430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c420 tx=0x7f5be800c8e0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 shutdown_connections 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5be4066550 0x7f5be4068a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bf81503c0 0x7f5bf8145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bf80c7cd0 0x7f5bf80ca430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 --2- 172.21.15.133:0/1427728752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bf8072760 0x7f5bf8143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 >> 172.21.15.133:0/1427728752 conn(0x7f5bf806aa60 msgr2=0x7f5bf806d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 shutdown_connections 2024-01-19T04:31:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.066+0000 7f5bfdb6d640 1 -- 172.21.15.133:0/1427728752 wait complete. 2024-01-19T04:31:42.085 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:31:42.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 Processor -- start 2024-01-19T04:31:42.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 -- start start 2024-01-19T04:31:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f845c070750 0x7f845c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f845c06afe0 0x7f845c06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c06b930 con 0x7f845c1516b0 2024-01-19T04:31:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c15b2c0 con 0x7f845c070750 2024-01-19T04:31:42.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f8463425640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c151a90 con 0x7f845c06afe0 2024-01-19T04:31:42.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f84611c1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f845c1516b0 0x7f845c0c7870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40766/0 (socket says 172.21.15.133:40766) 2024-01-19T04:31:42.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f84611c1640 1 -- 172.21.15.133:0/2220562493 learned_addr learned my addr 172.21.15.133:0/2220562493 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:42.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f84609c0640 1 --2- 172.21.15.133:0/2220562493 >> v2:172.21.15.133:3300/0 conn(0x7f845c070750 0x7f845c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.206+0000 7f84619c2640 1 --2- 172.21.15.133:0/2220562493 >> v2:172.21.15.156:3300/0 conn(0x7f845c06afe0 0x7f845c06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.214+0000 7f84609c0640 1 -- 172.21.15.133:0/2220562493 >> v2:172.21.15.156:3300/0 conn(0x7f845c06afe0 msgr2=0x7f845c06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:42.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.214+0000 7f84609c0640 1 --2- 172.21.15.133:0/2220562493 >> v2:172.21.15.156:3300/0 conn(0x7f845c06afe0 0x7f845c06b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.214+0000 7f84609c0640 1 -- 172.21.15.133:0/2220562493 >> v1:172.21.15.133:6789/0 conn(0x7f845c1516b0 legacy=0x7f845c0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.214+0000 7f84609c0640 1 -- 172.21.15.133:0/2220562493 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0c68c0 con 0x7f845c070750 2024-01-19T04:31:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.218+0000 7f84609c0640 1 --2- 172.21.15.133:0/2220562493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c070750 0x7f845c157dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f845c0c63f0 tx=0x7f844c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836552ded4ee9a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8453fff640 1 -- 172.21.15.133:0/2220562493 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0a8950 con 0x7f845c070750 2024-01-19T04:31:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8453fff640 1 -- 172.21.15.133:0/2220562493 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0a8ab0 con 0x7f845c070750 2024-01-19T04:31:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8453fff640 1 -- 172.21.15.133:0/2220562493 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0a8e40 con 0x7f845c070750 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- 172.21.15.133:0/2220562493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c070750 msgr2=0x7f845c157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 --2- 172.21.15.133:0/2220562493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c070750 0x7f845c157dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f845c0c63f0 tx=0x7f844c01ec70 comp rx=0 tx=0).stop 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- 172.21.15.133:0/2220562493 shutdown_connections 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 --2- 172.21.15.133:0/2220562493 >> v2:172.21.15.156:3300/0 conn(0x7f845c06afe0 0x7f845c06b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 --2- 172.21.15.133:0/2220562493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c070750 0x7f845c157dd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- 172.21.15.133:0/2220562493 >> 172.21.15.133:0/2220562493 conn(0x7f845c072450 msgr2=0x7f845c06fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- 172.21.15.133:0/2220562493 shutdown_connections 2024-01-19T04:31:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- 172.21.15.133:0/2220562493 wait complete. 2024-01-19T04:31:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 Processor -- start 2024-01-19T04:31:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- start start 2024-01-19T04:31:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 0x7f845c1ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c070750 0x7f845c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c1516b0 0x7f845c0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c149f00 con 0x7f845c06afe0 2024-01-19T04:31:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1489e0 con 0x7f845c070750 2024-01-19T04:31:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f8463425640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c148700 con 0x7f845c1516b0 2024-01-19T04:31:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.222+0000 7f84611c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 0x7f845c1ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 0x7f845c1ef400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44604/0 (socket says 172.21.15.133:44604) 2024-01-19T04:31:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 -- 172.21.15.133:0/904988254 learned_addr learned my addr 172.21.15.133:0/904988254 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84619c2640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c1516b0 0x7f845c0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 -- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c1516b0 msgr2=0x7f845c0ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c1516b0 0x7f845c0ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 -- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c070750 msgr2=0x7f845c14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c070750 0x7f845c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.226+0000 7f84611c1640 1 -- 172.21.15.133:0/904988254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009420 con 0x7f845c06afe0 2024-01-19T04:31:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.230+0000 7f84611c1640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 0x7f845c1ef400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f845800c370 tx=0x7f845800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.234+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458005cf0 con 0x7f845c06afe0 2024-01-19T04:31:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.234+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458005e50 con 0x7f845c06afe0 2024-01-19T04:31:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.234+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c14b090 con 0x7f845c06afe0 2024-01-19T04:31:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.234+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580072d0 con 0x7f845c06afe0 2024-01-19T04:31:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.234+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c14a130 con 0x7f845c06afe0 2024-01-19T04:31:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.234+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c14b540 con 0x7f845c06afe0 2024-01-19T04:31:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.514+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8458007430 con 0x7f845c06afe0 2024-01-19T04:31:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.518+0000 7f8451ffb640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8440066550 0x7f8440068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.518+0000 7f84609c0640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8440066550 0x7f8440068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.518+0000 7f84609c0640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8440066550 0x7f8440068a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f844c0b2000 tx=0x7f844c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:42.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.550+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8458054890 con 0x7f845c06afe0 2024-01-19T04:31:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.550+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8458050bd0 con 0x7f845c06afe0 2024-01-19T04:31:42.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.746+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f845c074340 con 0x7f845c06afe0 2024-01-19T04:31:42.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.818+0000 7f8451ffb640 1 -- 172.21.15.133:0/904988254 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6526 (secure 0 0 0) 0x7f8458017090 con 0x7f845c06afe0 2024-01-19T04:31:42.820 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:42.820 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:31:40.955163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-19T04:31:42.820 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8440066550 msgr2=0x7f8440068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8440066550 0x7f8440068a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f844c0b2000 tx=0x7f844c004740 comp rx=0 tx=0).stop 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 msgr2=0x7f845c1ef400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 0x7f845c1ef400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f845800c370 tx=0x7f845800c830 comp rx=0 tx=0).stop 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 shutdown_connections 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8440066550 0x7f8440068a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c070750 0x7f845c14a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c1516b0 0x7f845c0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 --2- 172.21.15.133:0/904988254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f845c06afe0 0x7f845c1ef400 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 >> 172.21.15.133:0/904988254 conn(0x7f845c072450 msgr2=0x7f845c0c0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:42.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 shutdown_connections 2024-01-19T04:31:42.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.822+0000 7f8463425640 1 -- 172.21.15.133:0/904988254 wait complete. 2024-01-19T04:31:42.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:42.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe694eef640 1 Processor -- start 2024-01-19T04:31:42.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe694eef640 1 -- start start 2024-01-19T04:31:42.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe694eef640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe6901517b0 0x7fe69015b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe694eef640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69006fe80 con 0x7fe6900c7260 2024-01-19T04:31:42.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe694eef640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69015abf0 con 0x7fe69006afa0 2024-01-19T04:31:42.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe694eef640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69015bb80 con 0x7fe6901517b0 2024-01-19T04:31:42.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.957+0000 7fe68e59c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe6901517b0 0x7fe69015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.961+0000 7fe687fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe6900c7260 0x7fe690158080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40780/0 (socket says 172.21.15.133:40780) 2024-01-19T04:31:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.961+0000 7fe687fff640 1 -- 172.21.15.133:0/112623769 learned_addr learned my addr 172.21.15.133:0/112623769 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:42.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.961+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984297797 0 0) 0x7fe69006fe80 con 0x7fe6900c7260 2024-01-19T04:31:42.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.961+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe67c003530 con 0x7fe6900c7260 2024-01-19T04:31:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3248449466 0 0) 0x7fe67c003530 con 0x7fe6900c7260 2024-01-19T04:31:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 >> v2:172.21.15.156:3300/0 conn(0x7fe6901517b0 msgr2=0x7fe69015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 --2- 172.21.15.133:0/112623769 >> v2:172.21.15.156:3300/0 conn(0x7fe6901517b0 0x7fe69015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 >> v1:172.21.15.156:6789/0 conn(0x7fe69006afa0 legacy=0x7fe6900cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900700b0 con 0x7fe6900c7260 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fe678001680 con 0x7fe6900c7260 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 >> v1:172.21.15.133:6789/0 conn(0x7fe6900c7260 legacy=0x7fe690158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe67c0039d0 0x7fe67c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe67c0047d0 0x7fe67c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c005190 0x7fe67c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69015bb80 con 0x7fe67c0039d0 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c00c070 con 0x7fe67c0047d0 2024-01-19T04:31:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.965+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c00c230 con 0x7fe67c005190 2024-01-19T04:31:42.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.969+0000 7fe68e59c640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe67c0039d0 0x7fe67c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68ed9d640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c005190 0x7fe67c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68e59c640 1 -- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c005190 msgr2=0x7fe67c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:42.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68e59c640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c005190 0x7fe67c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68e59c640 1 -- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe67c0047d0 msgr2=0x7fe67c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:42.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68e59c640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe67c0047d0 0x7fe67c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68e59c640 1 -- 172.21.15.133:0/112623769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c003530 con 0x7fe67c0039d0 2024-01-19T04:31:42.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.973+0000 7fe68ed9d640 1 -- 172.21.15.133:0/112623769 reap_dead start 2024-01-19T04:31:42.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.977+0000 7fe68e59c640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe67c0039d0 0x7fe67c003df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ae0 tx=0x7fe68001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d001cc608c1ddb3f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5660 con 0x7fe67c0039d0 2024-01-19T04:31:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800a57c0 con 0x7fe67c0039d0 2024-01-19T04:31:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe68dd9b640 1 -- 172.21.15.133:0/112623769 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5b70 con 0x7fe67c0039d0 2024-01-19T04:31:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 -- 172.21.15.133:0/112623769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe67c0039d0 msgr2=0x7fe67c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe67c0039d0 0x7fe67c003df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ae0 tx=0x7fe68001ca70 comp rx=0 tx=0).stop 2024-01-19T04:31:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 -- 172.21.15.133:0/112623769 shutdown_connections 2024-01-19T04:31:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 --2- 172.21.15.133:0/112623769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe67c0039d0 0x7fe67c003df0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 -- 172.21.15.133:0/112623769 >> 172.21.15.133:0/112623769 conn(0x7fe6900720a0 msgr2=0x7fe6900724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:42.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 -- 172.21.15.133:0/112623769 shutdown_connections 2024-01-19T04:31:42.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.981+0000 7fe694eef640 1 -- 172.21.15.133:0/112623769 wait complete. 2024-01-19T04:31:42.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 Processor -- start 2024-01-19T04:31:42.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 -- start start 2024-01-19T04:31:42.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c0039d0 0x7fe6901eb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 0x7fe69014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6900c2080 0x7fe6900c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:42.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe690156f40 con 0x7fe69014cbd0 2024-01-19T04:31:42.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69014d030 con 0x7fe6900c2080 2024-01-19T04:31:42.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe694eef640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900c9350 con 0x7fe67c0039d0 2024-01-19T04:31:42.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe687fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 0x7fe69014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe687fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 0x7fe69014b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44608/0 (socket says 172.21.15.133:44608) 2024-01-19T04:31:42.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe687fff640 1 -- 172.21.15.133:0/3759928947 learned_addr learned my addr 172.21.15.133:0/3759928947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:42.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.985+0000 7fe68e59c640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c0039d0 0x7fe6901eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe68ed9d640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6900c2080 0x7fe6900c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:42.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe687fff640 1 -- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c0039d0 msgr2=0x7fe6901eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe687fff640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c0039d0 0x7fe6901eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe687fff640 1 -- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6900c2080 msgr2=0x7fe6900c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:42.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe687fff640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6900c2080 0x7fe6900c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:42.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe687fff640 1 -- 172.21.15.133:0/3759928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900c9070 con 0x7fe69014cbd0 2024-01-19T04:31:42.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.989+0000 7fe687fff640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 0x7fe69014b2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe678001000 tx=0x7fe67800f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:42.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.997+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678007d00 con 0x7fe69014cbd0 2024-01-19T04:31:42.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.997+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678007e80 con 0x7fe69014cbd0 2024-01-19T04:31:42.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.997+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6901ead50 con 0x7fe69014cbd0 2024-01-19T04:31:42.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.997+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67800a310 con 0x7fe69014cbd0 2024-01-19T04:31:42.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.997+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6901eb310 con 0x7fe69014cbd0 2024-01-19T04:31:42.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:42.997+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe690074340 con 0x7fe69014cbd0 2024-01-19T04:31:43.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.393+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe67800a470 con 0x7fe69014cbd0 2024-01-19T04:31:43.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.393+0000 7fe686ffd640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe670066580 0x7fe670068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:43.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.393+0000 7fe68e59c640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe670066580 0x7fe670068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:43.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.393+0000 7fe68e59c640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe670066580 0x7fe670068a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6800af000 tx=0x7fe6800046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:43.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.429+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe678058920 con 0x7fe69014cbd0 2024-01-19T04:31:43.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.429+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe678054560 con 0x7fe69014cbd0 2024-01-19T04:31:43.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.585+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69006b490 con 0x7fe69014cbd0 2024-01-19T04:31:43.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.693+0000 7fe686ffd640 1 -- 172.21.15.133:0/3759928947 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7fe678057b80 con 0x7fe69014cbd0 2024-01-19T04:31:43.697 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:43.697 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe670066580 msgr2=0x7fe670068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe670066580 0x7fe670068a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6800af000 tx=0x7fe6800046d0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 msgr2=0x7fe69014b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 0x7fe69014b2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe678001000 tx=0x7fe67800f8f0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 shutdown_connections 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe670066580 0x7fe670068a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6900c2080 0x7fe6900c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe69014cbd0 0x7fe69014b2c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 --2- 172.21.15.133:0/3759928947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe67c0039d0 0x7fe6901eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 >> 172.21.15.133:0/3759928947 conn(0x7fe6900720a0 msgr2=0x7fe690156460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 shutdown_connections 2024-01-19T04:31:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.697+0000 7fe694eef640 1 -- 172.21.15.133:0/3759928947 wait complete. 2024-01-19T04:31:43.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.865+0000 7f7ef8b24640 1 Processor -- start 2024-01-19T04:31:43.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.865+0000 7f7ef8b24640 1 -- start start 2024-01-19T04:31:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.869+0000 7f7ef8b24640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.869+0000 7f7ef8b24640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ef40c67e0 0x7f7ef40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.869+0000 7f7ef8b24640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef406f7c0 con 0x7f7ef40c0e90 2024-01-19T04:31:43.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.869+0000 7f7ef8b24640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef40c2980 con 0x7f7ef40c67e0 2024-01-19T04:31:43.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.869+0000 7f7ef8b24640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef406fa10 con 0x7f7ef4150610 2024-01-19T04:31:43.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.909+0000 7f7ef1d9b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ef40c67e0 0x7f7ef40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.973+0000 7f7ef259c640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.973+0000 7f7ef259c640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:47000/0 (socket says 172.21.15.133:47000) 2024-01-19T04:31:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.973+0000 7f7ef259c640 1 -- 172.21.15.133:0/3281264925 learned_addr learned my addr 172.21.15.133:0/3281264925 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:43.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.981+0000 7f7ef259c640 1 -- 172.21.15.133:0/3281264925 >> v2:172.21.15.156:3300/0 conn(0x7f7ef40c67e0 msgr2=0x7f7ef40c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:43.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.981+0000 7f7ef259c640 1 --2- 172.21.15.133:0/3281264925 >> v2:172.21.15.156:3300/0 conn(0x7f7ef40c67e0 0x7f7ef40c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:43.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.981+0000 7f7ef259c640 1 -- 172.21.15.133:0/3281264925 >> v1:172.21.15.156:6789/0 conn(0x7f7ef40c0e90 legacy=0x7f7ef406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:43.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.981+0000 7f7ef259c640 1 -- 172.21.15.133:0/3281264925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4070570 con 0x7f7ef4150610 2024-01-19T04:31:43.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:43.993+0000 7f7ef259c640 1 --2- 172.21.15.133:0/3281264925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41563f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009e50 tx=0x7f7eec01f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9597a65157f42d0c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:44.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef159a640 1 -- 172.21.15.133:0/3281264925 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0af400 con 0x7f7ef4150610 2024-01-19T04:31:44.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef159a640 1 -- 172.21.15.133:0/3281264925 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec0ab050 con 0x7f7ef4150610 2024-01-19T04:31:44.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef159a640 1 -- 172.21.15.133:0/3281264925 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0af780 con 0x7f7ef4150610 2024-01-19T04:31:44.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3281264925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 msgr2=0x7f7ef41563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3281264925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41563f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009e50 tx=0x7f7eec01f1c0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3281264925 shutdown_connections 2024-01-19T04:31:44.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3281264925 >> v2:172.21.15.156:3300/0 conn(0x7f7ef40c67e0 0x7f7ef40c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3281264925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41563f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3281264925 >> 172.21.15.133:0/3281264925 conn(0x7f7ef406de30 msgr2=0x7f7ef406e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:44.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3281264925 shutdown_connections 2024-01-19T04:31:44.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.005+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3281264925 wait complete. 2024-01-19T04:31:44.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 Processor -- start 2024-01-19T04:31:44.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 -- start start 2024-01-19T04:31:44.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ef40c0e90 0x7f7ef4143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 0x7f7ef41e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4155b80 con 0x7f7ef40c67e0 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef414aca0 con 0x7f7ef40c0e90 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef8b24640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41ef220 con 0x7f7ef4150610 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.009+0000 7f7ef1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 0x7f7ef41e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.013+0000 7f7ef1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 0x7f7ef41e3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44622/0 (socket says 172.21.15.133:44622) 2024-01-19T04:31:44.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.013+0000 7f7ef1d9b640 1 -- 172.21.15.133:0/3902072201 learned_addr learned my addr 172.21.15.133:0/3902072201 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:44.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.017+0000 7f7ef1d9b640 1 -- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 msgr2=0x7f7ef41e43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.017+0000 7f7ef1d9b640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.017+0000 7f7ef1d9b640 1 -- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ef40c0e90 msgr2=0x7f7ef4143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.017+0000 7f7ef1d9b640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ef40c0e90 0x7f7ef4143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.017+0000 7f7ef1d9b640 1 -- 172.21.15.133:0/3902072201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009b30 con 0x7f7ef40c67e0 2024-01-19T04:31:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.017+0000 7f7ef1d9b640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 0x7f7ef41e3e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c7f0 tx=0x7f7ee400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:44.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.025+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4004220 con 0x7f7ef40c67e0 2024-01-19T04:31:44.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.025+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40043a0 con 0x7f7ef40c67e0 2024-01-19T04:31:44.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.025+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4004510 con 0x7f7ef40c67e0 2024-01-19T04:31:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.025+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef40c2f90 con 0x7f7ef40c67e0 2024-01-19T04:31:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.025+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef41ef7e0 con 0x7f7ef40c67e0 2024-01-19T04:31:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.025+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef40c2df0 con 0x7f7ef40c67e0 2024-01-19T04:31:44.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.049+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7ee4003a70 con 0x7f7ef40c67e0 2024-01-19T04:31:44.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.049+0000 7f7eeaffd640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7ed8066550 0x7f7ed8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.053+0000 7f7ef259c640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7ed8066550 0x7f7ed8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.053+0000 7f7ef259c640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7ed8066550 0x7f7ed8068a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0b1000 tx=0x7f7eec004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.329+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ee4055730 con 0x7f7ef40c67e0 2024-01-19T04:31:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.329+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7ee4051370 con 0x7f7ef40c67e0 2024-01-19T04:31:44.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.513+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ef40c2df0 con 0x7f7ef40c67e0 2024-01-19T04:31:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.605+0000 7f7eeaffd640 1 -- 172.21.15.133:0/3902072201 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f7ef40c2df0 con 0x7f7ef40c67e0 2024-01-19T04:31:44.609 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:44.609 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7ed8066550 msgr2=0x7f7ed8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7ed8066550 0x7f7ed8068a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0b1000 tx=0x7f7eec004ac0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 msgr2=0x7f7ef41e3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 0x7f7ef41e3e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c7f0 tx=0x7f7ee400ccb0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 shutdown_connections 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7ed8066550 0x7f7ed8068a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ef4150610 0x7f7ef41e43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ef40c67e0 0x7f7ef41e3e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 --2- 172.21.15.133:0/3902072201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ef40c0e90 0x7f7ef4143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 >> 172.21.15.133:0/3902072201 conn(0x7f7ef406de30 msgr2=0x7f7ef414cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 shutdown_connections 2024-01-19T04:31:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.609+0000 7f7ef8b24640 1 -- 172.21.15.133:0/3902072201 wait complete. 2024-01-19T04:31:44.647 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:31:44.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30c37d640 1 Processor -- start 2024-01-19T04:31:44.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30c37d640 1 -- start start 2024-01-19T04:31:44.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30c37d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3041519e0 0x7fb30415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30c37d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb304158390 con 0x7fb30406f350 2024-01-19T04:31:44.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30c37d640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30415b0e0 con 0x7fb304151600 2024-01-19T04:31:44.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30c37d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb304157b70 con 0x7fb3041519e0 2024-01-19T04:31:44.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30a91a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb30406f350 0x7fb3040cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40788/0 (socket says 172.21.15.133:40788) 2024-01-19T04:31:44.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.769+0000 7fb30a91a640 1 -- 172.21.15.133:0/3026297387 learned_addr learned my addr 172.21.15.133:0/3026297387 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:44.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.773+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420262749 0 0) 0x7fb304158390 con 0x7fb30406f350 2024-01-19T04:31:44.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.773+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f0003530 con 0x7fb30406f350 2024-01-19T04:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3424381622 0 0) 0x7fb2f0003530 con 0x7fb30406f350 2024-01-19T04:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 >> v2:172.21.15.156:3300/0 conn(0x7fb3041519e0 msgr2=0x7fb30415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 --2- 172.21.15.133:0/3026297387 >> v2:172.21.15.156:3300/0 conn(0x7fb3041519e0 0x7fb30415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 >> v1:172.21.15.156:6789/0 conn(0x7fb304151600 legacy=0x7fb304157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304157dd0 con 0x7fb30406f350 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fb2fc001a00 con 0x7fb30406f350 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 >> v1:172.21.15.133:6789/0 conn(0x7fb30406f350 legacy=0x7fb3040cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00039d0 0x7fb2f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f00047d0 0x7fb2f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f00052b0 0x7fb2f000fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb304157b70 con 0x7fb2f00047d0 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0010610 con 0x7fb2f00052b0 2024-01-19T04:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.781+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00107d0 con 0x7fb2f00039d0 2024-01-19T04:31:44.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.785+0000 7fb30a119640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00039d0 0x7fb2f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.785+0000 7fb309918640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f00047d0 0x7fb2f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.789+0000 7fb30a91a640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f00052b0 0x7fb2f000fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb309918640 1 -- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00039d0 msgr2=0x7fb2f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb309918640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00039d0 0x7fb2f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb309918640 1 -- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f00052b0 msgr2=0x7fb2f000fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb309918640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f00052b0 0x7fb2f000fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb309918640 1 -- 172.21.15.133:0/3026297387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0003530 con 0x7fb2f00047d0 2024-01-19T04:31:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb30a91a640 1 -- 172.21.15.133:0/3026297387 reap_dead start 2024-01-19T04:31:44.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.793+0000 7fb309918640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f00047d0 0x7fb2f0004c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009860 tx=0x7fb2f401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2edf5601d6e59a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:44.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40ab600 con 0x7fb2f00047d0 2024-01-19T04:31:44.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f40a7050 con 0x7fb2f00047d0 2024-01-19T04:31:44.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb309117640 1 -- 172.21.15.133:0/3026297387 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40aba00 con 0x7fb2f00047d0 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 -- 172.21.15.133:0/3026297387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f00047d0 msgr2=0x7fb2f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f00047d0 0x7fb2f0004c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009860 tx=0x7fb2f401c320 comp rx=0 tx=0).stop 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 -- 172.21.15.133:0/3026297387 shutdown_connections 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 --2- 172.21.15.133:0/3026297387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f00047d0 0x7fb2f0004c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 -- 172.21.15.133:0/3026297387 >> 172.21.15.133:0/3026297387 conn(0x7fb30406d590 msgr2=0x7fb304066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 -- 172.21.15.133:0/3026297387 shutdown_connections 2024-01-19T04:31:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 -- 172.21.15.133:0/3026297387 wait complete. 2024-01-19T04:31:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 Processor -- start 2024-01-19T04:31:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.801+0000 7fb30c37d640 1 -- start start 2024-01-19T04:31:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30c37d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00047d0 0x7fb3040c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30c37d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 0x7fb304156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30c37d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb30414f6f0 0x7fb304145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30c37d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3041575e0 con 0x7fb304145e80 2024-01-19T04:31:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30c37d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3041ea3f0 con 0x7fb30414f6f0 2024-01-19T04:31:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30c37d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040c4a60 con 0x7fb2f00047d0 2024-01-19T04:31:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb309918640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 0x7fb304156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb309918640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 0x7fb304156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44636/0 (socket says 172.21.15.133:44636) 2024-01-19T04:31:44.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb309918640 1 -- 172.21.15.133:0/2303040933 learned_addr learned my addr 172.21.15.133:0/2303040933 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:44.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30a119640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00047d0 0x7fb3040c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.805+0000 7fb30a91a640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb30414f6f0 0x7fb304145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.809+0000 7fb309918640 1 -- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00047d0 msgr2=0x7fb3040c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.809+0000 7fb309918640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00047d0 0x7fb3040c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.809+0000 7fb309918640 1 -- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb30414f6f0 msgr2=0x7fb304145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.809+0000 7fb309918640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb30414f6f0 0x7fb304145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.809+0000 7fb309918640 1 -- 172.21.15.133:0/2303040933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3041ea6b0 con 0x7fb304145e80 2024-01-19T04:31:44.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.813+0000 7fb309918640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 0x7fb304156590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb2f401cbc0 tx=0x7fb2f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:44.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.817+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40b4600 con 0x7fb304145e80 2024-01-19T04:31:44.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.817+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f40b4760 con 0x7fb304145e80 2024-01-19T04:31:44.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.817+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40b4ad0 con 0x7fb304145e80 2024-01-19T04:31:44.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.817+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3041ea990 con 0x7fb304145e80 2024-01-19T04:31:44.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.817+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3041eaf50 con 0x7fb304145e80 2024-01-19T04:31:44.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:44.817+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3040c6c20 con 0x7fb304145e80 2024-01-19T04:31:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.097+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb2f40b2040 con 0x7fb304145e80 2024-01-19T04:31:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.097+0000 7fb2faffd640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb2e8066500 0x7fb2e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.097+0000 7fb30a119640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb2e8066500 0x7fb2e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:45.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.097+0000 7fb30a119640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb2e8066500 0x7fb2e80689c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb300007fd0 tx=0x7fb300009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:45.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.129+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb2f40ee630 con 0x7fb304145e80 2024-01-19T04:31:45.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.129+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb2f40ea970 con 0x7fb304145e80 2024-01-19T04:31:45.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.325+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb304071fa0 con 0x7fb304145e80 2024-01-19T04:31:45.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb2faffd640 1 -- 172.21.15.133:0/2303040933 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6526 (secure 0 0 0) 0x7fb2f40b0090 con 0x7fb304145e80 2024-01-19T04:31:45.358 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:45.358 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:31:40.955163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-19T04:31:45.358 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb2e8066500 msgr2=0x7fb2e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb2e8066500 0x7fb2e80689c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb300007fd0 tx=0x7fb300009040 comp rx=0 tx=0).stop 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 msgr2=0x7fb304156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 0x7fb304156590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb2f401cbc0 tx=0x7fb2f0005800 comp rx=0 tx=0).stop 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 shutdown_connections 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb2e8066500 0x7fb2e80689c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb30414f6f0 0x7fb304145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb304145e80 0x7fb304156590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 --2- 172.21.15.133:0/2303040933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2f00047d0 0x7fb3040c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 >> 172.21.15.133:0/2303040933 conn(0x7fb30406d590 msgr2=0x7fb3040c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 shutdown_connections 2024-01-19T04:31:45.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.357+0000 7fb30c37d640 1 -- 172.21.15.133:0/2303040933 wait complete. 2024-01-19T04:31:45.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:45.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3ba50d2640 1 Processor -- start 2024-01-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3ba50d2640 1 -- start start 2024-01-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3ba50d2640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba0150620 0x7f3ba00c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3ba50d2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00c2950 con 0x7f3ba00c2de0 2024-01-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3ba50d2640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba0159800 con 0x7f3ba00c7570 2024-01-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3ba50d2640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0150a00 con 0x7f3ba0150620 2024-01-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3b9f59e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3ba00c2de0 0x7f3ba00c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40790/0 (socket says 172.21.15.133:40790) 2024-01-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.505+0000 7f3b9f59e640 1 -- 172.21.15.133:0/3943036677 learned_addr learned my addr 172.21.15.133:0/3943036677 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:45.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.509+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262297938 0 0) 0x7f3ba00c2950 con 0x7f3ba00c2de0 2024-01-19T04:31:45.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.509+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b88003530 con 0x7f3ba00c2de0 2024-01-19T04:31:45.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559146295 0 0) 0x7f3b88003530 con 0x7f3ba00c2de0 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba0150620 msgr2=0x7f3ba00c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba0150620 0x7f3ba00c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 >> v1:172.21.15.156:6789/0 conn(0x7f3ba00c7570 legacy=0x7f3ba00c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00c7d50 con 0x7f3ba00c2de0 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f3b98001a00 con 0x7f3ba00c2de0 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 >> v1:172.21.15.133:6789/0 conn(0x7f3ba00c2de0 legacy=0x7f3ba00c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880039b0 0x7f3b88003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b880047d0 0x7f3b88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba0150620 0x7f3b8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0150a00 con 0x7f3b880047d0 2024-01-19T04:31:45.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88005580 con 0x7f3b880039b0 2024-01-19T04:31:45.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.513+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8800bed0 con 0x7f3ba0150620 2024-01-19T04:31:45.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.517+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b880047d0 0x7f3b88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:45.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.517+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba0150620 msgr2=0x7f3b8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:45.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.517+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba0150620 0x7f3b8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.517+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880039b0 msgr2=0x7f3b88003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:45.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.517+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880039b0 0x7f3b88003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.517+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3943036677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88003530 con 0x7f3b880047d0 2024-01-19T04:31:45.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.521+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b880047d0 0x7f3b88004c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001650 tx=0x7f3b9401c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e5728a25f3ce01 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:45.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94005270 con 0x7f3b880047d0 2024-01-19T04:31:45.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b940a7070 con 0x7f3b880047d0 2024-01-19T04:31:45.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3b9dd9b640 1 -- 172.21.15.133:0/3943036677 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94003860 con 0x7f3b880047d0 2024-01-19T04:31:45.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3943036677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b880047d0 msgr2=0x7f3b88004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:45.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3943036677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b880047d0 0x7f3b88004c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001650 tx=0x7f3b9401c2e0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3b9f59e640 1 -- 172.21.15.133:0/3943036677 reap_dead start 2024-01-19T04:31:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3943036677 shutdown_connections 2024-01-19T04:31:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3943036677 >> 172.21.15.133:0/3943036677 conn(0x7f3ba00cba50 msgr2=0x7f3ba00c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3943036677 shutdown_connections 2024-01-19T04:31:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.525+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3943036677 wait complete. 2024-01-19T04:31:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 Processor -- start 2024-01-19T04:31:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 -- start start 2024-01-19T04:31:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880047d0 0x7f3ba00ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 0x7f3ba014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba01538e0 0x7f3ba014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba014e080 con 0x7f3ba014f060 2024-01-19T04:31:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba014f940 con 0x7f3b880047d0 2024-01-19T04:31:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3ba50d2640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0153130 con 0x7f3ba01538e0 2024-01-19T04:31:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3b9e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 0x7f3ba014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3b9f59e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba01538e0 0x7f3ba014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:45.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3b9e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 0x7f3ba014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44658/0 (socket says 172.21.15.133:44658) 2024-01-19T04:31:45.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.529+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3185659816 learned_addr learned my addr 172.21.15.133:0/3185659816 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.533+0000 7f3b9ed9d640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880047d0 0x7f3ba00ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:45.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.533+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba01538e0 msgr2=0x7f3ba014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:45.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.533+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba01538e0 0x7f3ba014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.533+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880047d0 msgr2=0x7f3ba00ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:45.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.533+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880047d0 0x7f3ba00ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:45.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.533+0000 7f3b9e59c640 1 -- 172.21.15.133:0/3185659816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba014fbe0 con 0x7f3ba014f060 2024-01-19T04:31:45.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.537+0000 7f3b9e59c640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 0x7f3ba014e510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001650 tx=0x7f3b88005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:45.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.541+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940b3070 con 0x7f3ba014f060 2024-01-19T04:31:45.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.541+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94007300 con 0x7f3ba014f060 2024-01-19T04:31:45.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.541+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94007690 con 0x7f3ba014f060 2024-01-19T04:31:45.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.541+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba0152e20 con 0x7f3ba014f060 2024-01-19T04:31:45.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.541+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba00cab70 con 0x7f3ba014f060 2024-01-19T04:31:45.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.545+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba014e1f0 con 0x7f3ba014f060 2024-01-19T04:31:45.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.561+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3b940a9020 con 0x7f3ba014f060 2024-01-19T04:31:45.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.561+0000 7f3b877fe640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3b8c066530 0x7f3b8c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.565+0000 7f3b9ed9d640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3b8c066530 0x7f3b8c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.565+0000 7f3b9ed9d640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3b8c066530 0x7f3b8c0689f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:45.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.565+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b940eece0 con 0x7f3ba014f060 2024-01-19T04:31:45.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.829+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3b940ea920 con 0x7f3ba014f060 2024-01-19T04:31:45.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:45.993+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba014fdd0 con 0x7f3ba014f060 2024-01-19T04:31:46.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.077+0000 7f3b877fe640 1 -- 172.21.15.133:0/3185659816 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f3b940edf40 con 0x7f3ba014f060 2024-01-19T04:31:46.080 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:46.081 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3b8c066530 msgr2=0x7f3b8c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3b8c066530 0x7f3b8c0689f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b90008040 comp rx=0 tx=0).stop 2024-01-19T04:31:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 msgr2=0x7f3ba014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 0x7f3ba014e510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b94001650 tx=0x7f3b88005800 comp rx=0 tx=0).stop 2024-01-19T04:31:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 shutdown_connections 2024-01-19T04:31:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3b8c066530 0x7f3b8c0689f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ba01538e0 0x7f3ba014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba014f060 0x7f3ba014e510 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 --2- 172.21.15.133:0/3185659816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b880047d0 0x7f3ba00ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 >> 172.21.15.133:0/3185659816 conn(0x7f3ba00cba50 msgr2=0x7f3ba00c4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 shutdown_connections 2024-01-19T04:31:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.081+0000 7f3ba50d2640 1 -- 172.21.15.133:0/3185659816 wait complete. 2024-01-19T04:31:46.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T04:31:32.688148+0000', 'modified': '2024-01-19T04:31:40.955163+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4247}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4247': {'gid': 4247, 'name': 'e', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6837/3631439971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3631439971}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3631439971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-19T04:31:46.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T04:31:46.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-19T04:31:46.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 Processor -- start 2024-01-19T04:31:46.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 -- start start 2024-01-19T04:31:46.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ff81503c0 0x7f8ff80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff8072760 0x7f8ff8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ff80c7cd0 0x7f8ff80c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff8156760 con 0x7f8ff80c7cd0 2024-01-19T04:31:46.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff81507a0 con 0x7f8ff81503c0 2024-01-19T04:31:46.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffed6d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff8071a10 con 0x7f8ff8072760 2024-01-19T04:31:46.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffd30a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ff80c7cd0 0x7f8ff80c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffcb09640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ff81503c0 0x7f8ff80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ff7fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff8072760 0x7f8ff8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffd30a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ff80c7cd0 0x7f8ff80c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44662/0 (socket says 172.21.15.133:44662) 2024-01-19T04:31:46.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.849+0000 7f8ffd30a640 1 -- 172.21.15.133:0/839705195 learned_addr learned my addr 172.21.15.133:0/839705195 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.853+0000 7f8ffd30a640 1 -- 172.21.15.133:0/839705195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff8072760 msgr2=0x7f8ff8156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.853+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/839705195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff8072760 0x7f8ff8156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.853+0000 7f8ffd30a640 1 -- 172.21.15.133:0/839705195 >> v2:172.21.15.156:3300/0 conn(0x7f8ff81503c0 msgr2=0x7f8ff80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:46.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.853+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/839705195 >> v2:172.21.15.156:3300/0 conn(0x7f8ff81503c0 0x7f8ff80c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.853+0000 7f8ffd30a640 1 -- 172.21.15.133:0/839705195 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8071cf0 con 0x7f8ff80c7cd0 2024-01-19T04:31:46.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.857+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/839705195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c8140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8071690 tx=0x7f8ff001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a54c3d85cf3ad8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:46.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.861+0000 7f8ff77fe640 1 -- 172.21.15.133:0/839705195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00af400 con 0x7f8ff80c7cd0 2024-01-19T04:31:46.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ff77fe640 1 -- 172.21.15.133:0/839705195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff00ab050 con 0x7f8ff80c7cd0 2024-01-19T04:31:46.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ff77fe640 1 -- 172.21.15.133:0/839705195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00af780 con 0x7f8ff80c7cd0 2024-01-19T04:31:46.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 -- 172.21.15.133:0/839705195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff80c7cd0 msgr2=0x7f8ff80c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:46.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/839705195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c8140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8071690 tx=0x7f8ff001f1c0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 -- 172.21.15.133:0/839705195 shutdown_connections 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/839705195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c8140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/839705195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff8072760 0x7f8ff8156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/839705195 >> v2:172.21.15.156:3300/0 conn(0x7f8ff81503c0 0x7f8ff80c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 -- 172.21.15.133:0/839705195 >> 172.21.15.133:0/839705195 conn(0x7f8ff806aa60 msgr2=0x7f8ff806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 -- 172.21.15.133:0/839705195 shutdown_connections 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 -- 172.21.15.133:0/839705195 wait complete. 2024-01-19T04:31:46.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.865+0000 7f8ffed6d640 1 Processor -- start 2024-01-19T04:31:46.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 -- start start 2024-01-19T04:31:46.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 0x7f8ff81eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff81503c0 0x7f8ff814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c3590 con 0x7f8ff8072760 2024-01-19T04:31:46.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c26a0 con 0x7f8ff80c7cd0 2024-01-19T04:31:46.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffed6d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c2980 con 0x7f8ff81503c0 2024-01-19T04:31:46.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 0x7f8ff81eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 0x7f8ff81eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44676/0 (socket says 172.21.15.133:44676) 2024-01-19T04:31:46.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2405948857 learned_addr learned my addr 172.21.15.133:0/2405948857 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:46.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff81503c0 0x7f8ff814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.869+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.873+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff81503c0 msgr2=0x7f8ff814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:46.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.873+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff81503c0 0x7f8ff814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.873+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ff80c7cd0 msgr2=0x7f8ff80c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:46.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.873+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.873+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2405948857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0009b30 con 0x7f8ff8072760 2024-01-19T04:31:46.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.877+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 0x7f8ff81eef30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e870 tx=0x7f8fe800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:46.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f8ff57fa640 1 -- 172.21.15.133:0/2405948857 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8009510 con 0x7f8ff8072760 2024-01-19T04:31:46.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f8ff57fa640 1 -- 172.21.15.133:0/2405948857 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe800eec0 con 0x7f8ff8072760 2024-01-19T04:31:46.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff80c2c60 con 0x7f8ff8072760 2024-01-19T04:31:46.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f8ff57fa640 1 -- 172.21.15.133:0/2405948857 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800cb40 con 0x7f8ff8072760 2024-01-19T04:31:46.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff80c3220 con 0x7f8ff8072760 2024-01-19T04:31:46.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f9001eca000 1 Processor -- start 2024-01-19T04:31:46.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.881+0000 7f9001eca000 1 -- start start 2024-01-19T04:31:46.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f9001eca000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 0x5633e95efd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95f0290 0x5633e95f0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f9001eca000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e93ead70 con 0x5633e95ea8b0 2024-01-19T04:31:46.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e93e6ba0 con 0x5633e95f0290 2024-01-19T04:31:46.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633e93e40d0 con 0x5633e95ef970 2024-01-19T04:31:46.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.885+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 0x5633e95efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.889+0000 7f8ff7fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95f0290 0x5633e95f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.889+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 0x5633e95efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:47066/0 (socket says 172.21.15.133:47066) 2024-01-19T04:31:46.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.889+0000 7f8ffcb09640 1 -- 172.21.15.133:0/4038349139 learned_addr learned my addr 172.21.15.133:0/4038349139 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:46.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.889+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.893+0000 7f8ffcb09640 1 -- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95f0290 msgr2=0x5633e95f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:46.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.893+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95f0290 0x5633e95f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.893+0000 7f8ffcb09640 1 -- 172.21.15.133:0/4038349139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 msgr2=0x5633e95eac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:46.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.893+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.893+0000 7f8ffcb09640 1 -- 172.21.15.133:0/4038349139 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633e90d6890 con 0x5633e95ef970 2024-01-19T04:31:46.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.897+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 0x5633e95efd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80c36d0 tx=0x7f8fe8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=288d648593500bfc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:46.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.901+0000 7f8ff57fa640 1 -- 172.21.15.133:0/2405948857 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8fe8013470 con 0x7f8ff8072760 2024-01-19T04:31:46.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.901+0000 7f8ff57fa640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8fe4066550 0x7f8fe4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.901+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8fe4066550 0x7f8fe4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.905+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8fe4066550 0x7f8fe4068a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00b1000 tx=0x7f8ff00aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:46.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.905+0000 7f8ff57fa640 1 -- 172.21.15.133:0/2405948857 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fe80579b0 con 0x7f8ff8072760 2024-01-19T04:31:46.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.909+0000 7f8fde7fc640 1 -- 172.21.15.133:0/4038349139 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8053cf0 con 0x5633e95ef970 2024-01-19T04:31:46.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.909+0000 7f8fde7fc640 1 -- 172.21.15.133:0/4038349139 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe8057780 con 0x5633e95ef970 2024-01-19T04:31:46.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.909+0000 7f8fde7fc640 1 -- 172.21.15.133:0/4038349139 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80574f0 con 0x5633e95ef970 2024-01-19T04:31:46.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.909+0000 7f9001eca000 1 -- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 msgr2=0x5633e95efd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:46.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.909+0000 7f9001eca000 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 0x5633e95efd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80c36d0 tx=0x7f8fe8013000 comp rx=0 tx=0).stop 2024-01-19T04:31:46.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- 172.21.15.133:0/4038349139 shutdown_connections 2024-01-19T04:31:46.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95f0290 0x5633e95f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95ef970 0x5633e95efd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 --2- 172.21.15.133:0/4038349139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- 172.21.15.133:0/4038349139 >> 172.21.15.133:0/4038349139 conn(0x5633e95eb720 msgr2=0x5633e95edb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:46.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- 172.21.15.133:0/4038349139 shutdown_connections 2024-01-19T04:31:46.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- 172.21.15.133:0/4038349139 wait complete. 2024-01-19T04:31:46.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- start start 2024-01-19T04:31:46.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 Processor -- start 2024-01-19T04:31:46.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e93df9c0 con 0x5633e95ea8b0 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e9397040 con 0x5633e95ef970 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633e939cee0 con 0x5633e95f0290 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f9001eca000 10 client.0 _ll_register_callbacks cb 0x5633e939a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44694/0 (socket says 172.21.15.133:44694) 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2144201175 learned_addr learned my addr 172.21.15.133:0/2144201175 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.913+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.917+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.917+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 msgr2=0x5633e95aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.917+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.917+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 msgr2=0x5633e95e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:46.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.917+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95e9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:46.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.917+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2144201175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff80c3220 con 0x5633e95ea8b0 2024-01-19T04:31:46.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.921+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95e94c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8fe805f6d0 tx=0x7f8fe805bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baa879c62b0f8d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:46.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.921+0000 7f8fd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:31:46.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.925+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2144201175 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8057e10 con 0x5633e95ea8b0 2024-01-19T04:31:46.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.925+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2144201175 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fe8055e10 con 0x5633e95ea8b0 2024-01-19T04:31:46.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.925+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633e9365e30 con 0x5633e95ea8b0 2024-01-19T04:31:46.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.925+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2144201175 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fe8056ea0 con 0x5633e95ea8b0 2024-01-19T04:31:46.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.925+0000 7f9001eca000 10 client.4329 fetch_fsmap learned FSMap version 8 2024-01-19T04:31:46.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.925+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5633e939f5e0 con 0x5633e95ea8b0 2024-01-19T04:31:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.929+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2144201175 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633e9365e30 con 0x5633e95ea8b0 2024-01-19T04:31:46.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2144201175 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f8fe8011070 con 0x5633e95ea8b0 2024-01-19T04:31:46.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f9001eca000 10 client.4329 fetch_fsmap finished waiting for FSMap version 8 2024-01-19T04:31:46.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f9001eca000 10 client.4329 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-19T04:31:46.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f9001eca000 20 client.4329 populate_metadata read hostname 'smithi133' 2024-01-19T04:31:46.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f9001eca000 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e95af920 0x5633e95afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:46.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f9001eca000 4 client.4329 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:31:46.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.933+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 --> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633e939c870 con 0x5633e95af920 2024-01-19T04:31:46.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:46.941+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e95af920 0x5633e95afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.029+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e95af920 0x5633e95afd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d5562648c0a3b11 server_cookie=6f1c14a77cb16922 in_seq=0 out_seq=0 2024-01-19T04:31:47.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.029+0000 7f8fd77fe640 10 client.4329 ms_handle_connect on v2:172.21.15.133:6836/3631439971 2024-01-19T04:31:47.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2144201175 <== mds.0 v2:172.21.15.133:6836/3631439971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5633e939c870 con 0x5633e95af920 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f8fd77fe640 10 client.4329 handle_command_reply: tid=0 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 client.4329 shutdown 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 msgr2=0x5633e95e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95e94c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8fe805f6d0 tx=0x7f8fe805bad0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 shutdown_connections 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e95af920 0x5633e95afd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f8fd77fe640 0 client.4329 ms_handle_reset on v2:172.21.15.133:6836/3631439971 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 --2- 172.21.15.133:0/2144201175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95e94c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 >> 172.21.15.133:0/2144201175 conn(0x5633e95eb720 msgr2=0x5633e95b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:47.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 shutdown_connections 2024-01-19T04:31:47.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 1 -- 172.21.15.133:0/2144201175 wait complete. 2024-01-19T04:31:47.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.245+0000 7f9001eca000 20 client.4329 trim_cache size 0 max 16384 2024-01-19T04:31:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 Processor -- start 2024-01-19T04:31:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 -- start start 2024-01-19T04:31:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e9097940 con 0x5633e95ea8b0 2024-01-19T04:31:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e93d6a40 con 0x5633e95ef970 2024-01-19T04:31:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.289+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633e93de850 con 0x5633e95f0290 2024-01-19T04:31:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.293+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.293+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44698/0 (socket says 172.21.15.133:44698) 2024-01-19T04:31:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.293+0000 7f8ffcb09640 1 -- 172.21.15.133:0/377169388 learned_addr learned my addr 172.21.15.133:0/377169388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.293+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.293+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.297+0000 7f8ffcb09640 1 -- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 msgr2=0x5633e95b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.297+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.297+0000 7f8ffcb09640 1 -- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 msgr2=0x5633e95b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.297+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.297+0000 7f8ffcb09640 1 -- 172.21.15.133:0/377169388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633e93858e0 con 0x5633e95ea8b0 2024-01-19T04:31:47.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.301+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eed30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8053eb0 tx=0x7f8fe805b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287f4d615965ade0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:47.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f8fddffb640 1 -- 172.21.15.133:0/377169388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80574f0 con 0x5633e95ea8b0 2024-01-19T04:31:47.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f8fddffb640 1 -- 172.21.15.133:0/377169388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe8055e10 con 0x5633e95ea8b0 2024-01-19T04:31:47.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f8fddffb640 1 -- 172.21.15.133:0/377169388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe806f040 con 0x5633e95ea8b0 2024-01-19T04:31:47.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 -- 172.21.15.133:0/377169388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 msgr2=0x5633e95eed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eed30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8053eb0 tx=0x7f8fe805b000 comp rx=0 tx=0).stop 2024-01-19T04:31:47.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 -- 172.21.15.133:0/377169388 shutdown_connections 2024-01-19T04:31:47.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e95b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e95b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 --2- 172.21.15.133:0/377169388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e95eed30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 -- 172.21.15.133:0/377169388 >> 172.21.15.133:0/377169388 conn(0x5633e95eb720 msgr2=0x5633e95ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:47.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 -- 172.21.15.133:0/377169388 shutdown_connections 2024-01-19T04:31:47.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.309+0000 7f9001eca000 1 -- 172.21.15.133:0/377169388 wait complete. 2024-01-19T04:31:47.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 -- start start 2024-01-19T04:31:47.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 Processor -- start 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e960af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e9609cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e960a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e93db330 con 0x5633e95ea8b0 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633e90d71b0 con 0x5633e95ef970 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633e9397040 con 0x5633e95f0290 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f9001eca000 10 client.0 _ll_register_callbacks cb 0x5633e93a00a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:31:47.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e960af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f8ffcb09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e960af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44712/0 (socket says 172.21.15.133:44712) 2024-01-19T04:31:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.313+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2499277745 learned_addr learned my addr 172.21.15.133:0/2499277745 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e9609cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ffd30a640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e960a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 msgr2=0x5633e960a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e960a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 msgr2=0x5633e9609cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e9609cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.317+0000 7f8ffcb09640 1 -- 172.21.15.133:0/2499277745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633e939f5e0 con 0x5633e95ea8b0 2024-01-19T04:31:47.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.321+0000 7f8ffcb09640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e960af90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8057480 tx=0x7f8fe8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682f3820c7608e01 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:47.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.321+0000 7f8fd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:31:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.325+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2499277745 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8057e10 con 0x5633e95ea8b0 2024-01-19T04:31:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.325+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2499277745 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fe802b070 con 0x5633e95ea8b0 2024-01-19T04:31:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.325+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633e95eb230 con 0x5633e95ea8b0 2024-01-19T04:31:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.329+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2499277745 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fe80574f0 con 0x5633e95ea8b0 2024-01-19T04:31:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.329+0000 7f9001eca000 10 client.4335 fetch_fsmap learned FSMap version 8 2024-01-19T04:31:47.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.329+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5633e90d6cc0 con 0x5633e95ea8b0 2024-01-19T04:31:47.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2499277745 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe8063080 con 0x5633e95ea8b0 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2499277745 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f8fe8011040 con 0x5633e95ea8b0 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f9001eca000 10 client.4335 fetch_fsmap finished waiting for FSMap version 8 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f9001eca000 10 client.4335 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f9001eca000 20 client.4335 populate_metadata read hostname 'smithi133' 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f9001eca000 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e96080f0 0x5633e96084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f9001eca000 4 client.4335 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 --> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5633e93914f0 con 0x5633e96080f0 2024-01-19T04:31:47.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.333+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e96080f0 0x5633e96084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.337+0000 7f8ff7fff640 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e96080f0 0x5633e96084d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab01c79357c7fc7 server_cookie=e62a3bc2a4cd8bf3 in_seq=0 out_seq=0 2024-01-19T04:31:47.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.337+0000 7f8fd77fe640 10 client.4335 ms_handle_connect on v2:172.21.15.133:6836/3631439971 2024-01-19T04:31:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8fd77fe640 1 -- 172.21.15.133:0/2499277745 <== mds.0 v2:172.21.15.133:6836/3631439971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5633e93914f0 con 0x5633e96080f0 2024-01-19T04:31:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8fd77fe640 10 client.4335 handle_command_reply: tid=0 2024-01-19T04:31:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 client.4335 shutdown 2024-01-19T04:31:47.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 msgr2=0x5633e960af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e960af90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8057480 tx=0x7f8fe8008030 comp rx=0 tx=0).stop 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 shutdown_connections 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5633e96080f0 0x5633e96084d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633e95ef970 0x5633e9609cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5633e95f0290 0x5633e960a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 --2- 172.21.15.133:0/2499277745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5633e95ea8b0 0x5633e960af90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8fd77fe640 0 client.4335 ms_handle_reset on v2:172.21.15.133:6836/3631439971 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 >> 172.21.15.133:0/2499277745 conn(0x5633e95eb720 msgr2=0x5633e95edb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 shutdown_connections 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 1 -- 172.21.15.133:0/2499277745 wait complete. 2024-01-19T04:31:47.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f9001eca000 20 client.4335 trim_cache size 0 max 16384 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "d3166d6e-d1d2-4f45-9af8-af169e4e9af8", 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4247, 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 13.071864382999999, 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 8, 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 28, 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 28, 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 32.803883558000003 2024-01-19T04:31:47.365 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:31:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8fe4066550 msgr2=0x7f8fe4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8fe4066550 0x7f8fe4068a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00b1000 tx=0x7f8ff00aa000 comp rx=0 tx=0).stop 2024-01-19T04:31:47.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 msgr2=0x7f8ff81eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 0x7f8ff81eef30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e870 tx=0x7f8fe800ec70 comp rx=0 tx=0).stop 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 shutdown_connections 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8fe4066550 0x7f8fe4068a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ff80c7cd0 0x7f8ff80c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ff81503c0 0x7f8ff814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 --2- 172.21.15.133:0/2405948857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ff8072760 0x7f8ff81eef30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 >> 172.21.15.133:0/2405948857 conn(0x7f8ff806aa60 msgr2=0x7f8ff806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 shutdown_connections 2024-01-19T04:31:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.361+0000 7f8ffed6d640 1 -- 172.21.15.133:0/2405948857 wait complete. 2024-01-19T04:31:47.395 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-19T04:31:47.396 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:47.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:31:47.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 Processor -- start 2024-01-19T04:31:47.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 -- start start 2024-01-19T04:31:47.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dcc153900 0x7f1dcc0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc0c8ea0 0x7f1dcc15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0c7620 con 0x7f1dcc0c93f0 2024-01-19T04:31:47.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c8b20 con 0x7f1dcc153900 2024-01-19T04:31:47.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd2b7f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c7b50 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd091b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dcc153900 0x7f1dcc0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd091b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dcc153900 0x7f1dcc0ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44724/0 (socket says 172.21.15.133:44724) 2024-01-19T04:31:47.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd091b640 1 -- 172.21.15.133:0/3096142358 learned_addr learned my addr 172.21.15.133:0/3096142358 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:47.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.521+0000 7f1dd111c640 1 --2- 172.21.15.133:0/3096142358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc0c8ea0 0x7f1dcc15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.525+0000 7f1dd091b640 1 -- 172.21.15.133:0/3096142358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc0c8ea0 msgr2=0x7f1dcc15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.525+0000 7f1dd091b640 1 --2- 172.21.15.133:0/3096142358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc0c8ea0 0x7f1dcc15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.525+0000 7f1dd091b640 1 -- 172.21.15.133:0/3096142358 >> v1:172.21.15.133:6789/0 conn(0x7f1dcc0c93f0 legacy=0x7f1dcc070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.525+0000 7f1dd091b640 1 -- 172.21.15.133:0/3096142358 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc15cd30 con 0x7f1dcc153900 2024-01-19T04:31:47.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.533+0000 7f1dd091b640 1 --2- 172.21.15.133:0/3096142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc153900 0x7f1dcc0ca200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009870 tx=0x7f1dbc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6d0f703c6e6c66 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:47.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dcb7fe640 1 -- 172.21.15.133:0/3096142358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0ab620 con 0x7f1dcc153900 2024-01-19T04:31:47.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dcb7fe640 1 -- 172.21.15.133:0/3096142358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0ab780 con 0x7f1dcc153900 2024-01-19T04:31:47.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dcb7fe640 1 -- 172.21.15.133:0/3096142358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0abb10 con 0x7f1dcc153900 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3096142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc153900 msgr2=0x7f1dcc0ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3096142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc153900 0x7f1dcc0ca200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009870 tx=0x7f1dbc01c510 comp rx=0 tx=0).stop 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3096142358 shutdown_connections 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3096142358 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc0c8ea0 0x7f1dcc15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3096142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc153900 0x7f1dcc0ca200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3096142358 >> 172.21.15.133:0/3096142358 conn(0x7f1dcc066b40 msgr2=0x7f1dcc06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:47.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3096142358 shutdown_connections 2024-01-19T04:31:47.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3096142358 wait complete. 2024-01-19T04:31:47.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.537+0000 7f1dd2b7f640 1 Processor -- start 2024-01-19T04:31:47.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 -- start start 2024-01-19T04:31:47.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 0x7f1dcc14b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0c93f0 0x7f1dcc1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc153900 0x7f1dcc0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cb950 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc14b1a0 con 0x7f1dcc0c93f0 2024-01-19T04:31:47.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd2b7f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cacd0 con 0x7f1dcc153900 2024-01-19T04:31:47.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd091b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 0x7f1dcc14b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd091b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 0x7f1dcc14b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44730/0 (socket says 172.21.15.133:44730) 2024-01-19T04:31:47.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd091b640 1 -- 172.21.15.133:0/3682828951 learned_addr learned my addr 172.21.15.133:0/3682828951 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dd111c640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc153900 0x7f1dcc0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.541+0000 7f1dcbfff640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0c93f0 0x7f1dcc1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.545+0000 7f1dd091b640 1 -- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc153900 msgr2=0x7f1dcc0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.545+0000 7f1dd091b640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc153900 0x7f1dcc0cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.545+0000 7f1dd091b640 1 -- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0c93f0 msgr2=0x7f1dcc1f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.545+0000 7f1dd091b640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0c93f0 0x7f1dcc1f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.545+0000 7f1dd091b640 1 -- 172.21.15.133:0/3682828951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc0094d0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.549+0000 7f1dd091b640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 0x7f1dcc14b3a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0ad040 tx=0x7f1dbc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:47.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.553+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0abdc0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.553+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0be3f0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.553+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0be7a0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.553+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0cafb0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.553+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc14bc70 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.553+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc151780 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.829+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1dbc0b43f0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.829+0000 7f1dc97fa640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1db8066550 0x7f1db8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:47.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.829+0000 7f1dcbfff640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1db8066550 0x7f1db8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:47.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.829+0000 7f1dcbfff640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1db8066550 0x7f1db8068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc15c0e0 tx=0x7f1dc0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.861+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dbc0ef3a0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:47.865+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1dbc0eb6e0 con 0x7f1dcc0c8ea0 2024-01-19T04:31:48.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.085+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1dcc071b40 con 0x7f1dcc0c8ea0 2024-01-19T04:31:48.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dc97fa640 1 -- 172.21.15.133:0/3682828951 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1dbc0eed00 con 0x7f1dcc0c8ea0 2024-01-19T04:31:48.098 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-19T04:31:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1db8066550 msgr2=0x7f1db8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1db8066550 0x7f1db8068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc15c0e0 tx=0x7f1dc0009040 comp rx=0 tx=0).stop 2024-01-19T04:31:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 msgr2=0x7f1dcc14b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 0x7f1dcc14b3a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0ad040 tx=0x7f1dbc01ad50 comp rx=0 tx=0).stop 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 shutdown_connections 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1db8066550 0x7f1db8068a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0c93f0 0x7f1dcc1f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1dcc153900 0x7f1dcc0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 --2- 172.21.15.133:0/3682828951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc0c8ea0 0x7f1dcc14b3a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 >> 172.21.15.133:0/3682828951 conn(0x7f1dcc066b40 msgr2=0x7f1dcc0c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 shutdown_connections 2024-01-19T04:31:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:48.097+0000 7f1dd2b7f640 1 -- 172.21.15.133:0/3682828951 wait complete. 2024-01-19T04:31:48.117 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:31:48.117 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:31:48.117 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-19T04:31:48.117 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-19T04:31:48.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:48.117 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:31:48.118 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-19T04:31:48.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:31:48.118 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-19T04:31:48.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.118 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-19T04:31:48.123 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:31:48.123 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:31:48.123 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:31:48.123 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:31:48.123 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-19T04:31:48.123 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-19T04:31:48.124 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42162sec preferred_lft 42162sec 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:79:c0:2c:b1 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:31:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:31:48.126 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-19T04:31:48.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-19T04:31:48.126 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:31:48.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.203 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:31:48.253 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-19T04:31:48.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.255 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:31:48.313 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:31:48.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.314 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:31:48.314 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:31:48.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:31:48.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:31:48.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:31:48.314 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:31:48.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.391 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-19T04:31:48.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.438 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-01-19T04:31:48.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.486 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:31:48.487 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:31:48.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:48.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-19T04:31:48.487 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:31:48.555 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-19T04:31:48.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-19T04:31:48.555 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:31:48.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.659 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:31:48.659 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:31:48.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-19T04:31:48.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2024-01-19T04:31:48.659 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:31:48.678 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-19T04:31:48.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:31:48.678 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:48.729 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-19T04:31:48.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:31:48.729 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:48.776 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:31:48.834 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:31:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:31:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:31:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:31:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:31:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:31:48.882 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:31:48.883 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:48.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:48.885 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:31:48.933 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-19T04:31:48.933 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-19T04:31:48.978 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:31:48.992 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:31:49.042 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:31:49.043 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:49.044 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:49.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:49.045 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:31:49.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:2024-01-19T04:31:49.109+0000 7f51d55b2580 -1 init, newargv = 0x55cde86f8490 newargc=15 2024-01-19T04:31:49.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:ceph-fuse[33294]: starting ceph client 2024-01-19T04:31:49.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:ceph-fuse[33294]: starting fuse 2024-01-19T04:31:50.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:31:50.207 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:50.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:50.257 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:31:50.305 INFO:teuthology.orchestra.run.smithi133.stdout:45 2024-01-19T04:31:50.305 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-01-19T04:31:50.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo stdin-killer -- python3 -c ' 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> import re 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> import os 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2024-01-19T04:31:50.306 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> return f 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.admin")) 2024-01-19T04:31:50.307 DEBUG:teuthology.orchestra.run.smithi133:> ' 2024-01-19T04:31:50.422 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.admin.33294.asok 2024-01-19T04:31:50.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-19T04:31:50.433 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33294.asok 2024-01-19T04:31:50.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:50.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33294.asok status 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "0edf41a622739843d6b978b179ff3227b476dd9d", 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)", 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "admin", 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "33294", 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2024-01-19T04:31:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4350, 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4350 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2024-01-19T04:31:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1719819995 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1719819995 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4350 192.168.0.1:0/1719819995", 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/1719819995", 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2024-01-19T04:31:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 8, 2024-01-19T04:31:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 28, 2024-01-19T04:31:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2024-01-19T04:31:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2024-01-19T04:31:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2024-01-19T04:31:50.584 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:31:50.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:50.595 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2024-01-19T04:31:50.595 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:50.631 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2024-01-19T04:31:50.631 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:50.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:50.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:31:50.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:31:50.786 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-19T04:31:51.103 INFO:teuthology.orchestra.run.smithi133.stdout:# file: . 2024-01-19T04:31:51.103 INFO:teuthology.orchestra.run.smithi133.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-19T04:31:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:51.104 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:31:51.104 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:31:51.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.281+0000 7f8bd51d3640 1 Processor -- start 2024-01-19T04:31:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.281+0000 7f8bd51d3640 1 -- start start 2024-01-19T04:31:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.281+0000 7f8bd51d3640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bd0151600 0x7f8bd015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.281+0000 7f8bd51d3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd0158390 con 0x7f8bd006f350 2024-01-19T04:31:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.281+0000 7f8bd51d3640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd015b0e0 con 0x7f8bd01519e0 2024-01-19T04:31:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.281+0000 7f8bd51d3640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd0157b70 con 0x7f8bd0151600 2024-01-19T04:31:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.285+0000 7f8bcf59e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8bd006f350 0x7f8bd00cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40806/0 (socket says 172.21.15.133:40806) 2024-01-19T04:31:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.285+0000 7f8bcf59e640 1 -- 172.21.15.133:0/3605982825 learned_addr learned my addr 172.21.15.133:0/3605982825 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.285+0000 7f8bced9d640 1 --2- 172.21.15.133:0/3605982825 >> v2:172.21.15.156:3300/0 conn(0x7f8bd0151600 0x7f8bd015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.285+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633773594 0 0) 0x7f8bd0158390 con 0x7f8bd006f350 2024-01-19T04:31:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.285+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb8003530 con 0x7f8bd006f350 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799483588 0 0) 0x7f8bb8003530 con 0x7f8bd006f350 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 >> v2:172.21.15.156:3300/0 conn(0x7f8bd0151600 msgr2=0x7f8bd015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 --2- 172.21.15.133:0/3605982825 >> v2:172.21.15.156:3300/0 conn(0x7f8bd0151600 0x7f8bd015b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 >> v1:172.21.15.156:6789/0 conn(0x7f8bd01519e0 legacy=0x7f8bd0157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0157dd0 con 0x7f8bd006f350 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f8bc8001a00 con 0x7f8bd006f350 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 >> v1:172.21.15.133:6789/0 conn(0x7f8bd006f350 legacy=0x7f8bd00cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb80039d0 0x7f8bb8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb80047d0 0x7f8bb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb8005190 0x7f8bb800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0157b70 con 0x7f8bb80047d0 2024-01-19T04:31:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80104a0 con 0x7f8bb8005190 2024-01-19T04:31:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.289+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8010660 con 0x7f8bb80039d0 2024-01-19T04:31:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.293+0000 7f8bced9d640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb80039d0 0x7f8bb8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.293+0000 7f8bce59c640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb80047d0 0x7f8bb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.297+0000 7f8bce59c640 1 -- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb80039d0 msgr2=0x7f8bb8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.297+0000 7f8bce59c640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bb80039d0 0x7f8bb8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.297+0000 7f8bce59c640 1 -- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb8005190 msgr2=0x7f8bb800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.297+0000 7f8bce59c640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb8005190 0x7f8bb800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.297+0000 7f8bce59c640 1 -- 172.21.15.133:0/3605982825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8003530 con 0x7f8bb80047d0 2024-01-19T04:31:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.297+0000 7f8bcf59e640 1 -- 172.21.15.133:0/3605982825 reap_dead start 2024-01-19T04:31:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.301+0000 7f8bce59c640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb80047d0 0x7f8bb8004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4001780 tx=0x7f8bc401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34332cdfc6c25198 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:51.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40052d0 con 0x7f8bb80047d0 2024-01-19T04:31:51.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc40a7050 con 0x7f8bb80047d0 2024-01-19T04:31:51.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bcdd9b640 1 -- 172.21.15.133:0/3605982825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4003600 con 0x7f8bb80047d0 2024-01-19T04:31:51.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- 172.21.15.133:0/3605982825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb80047d0 msgr2=0x7f8bb8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb80047d0 0x7f8bb8004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4001780 tx=0x7f8bc401c400 comp rx=0 tx=0).stop 2024-01-19T04:31:51.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- 172.21.15.133:0/3605982825 shutdown_connections 2024-01-19T04:31:51.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/3605982825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb80047d0 0x7f8bb8004c50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- 172.21.15.133:0/3605982825 >> 172.21.15.133:0/3605982825 conn(0x7f8bd006d590 msgr2=0x7f8bd0066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:51.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- 172.21.15.133:0/3605982825 shutdown_connections 2024-01-19T04:31:51.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- 172.21.15.133:0/3605982825 wait complete. 2024-01-19T04:31:51.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 Processor -- start 2024-01-19T04:31:51.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- start start 2024-01-19T04:31:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb80047d0 0x7f8bd0143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd00c0d30 0x7f8bd01eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 0x7f8bd0141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01ebce0 con 0x7f8bd01eb860 2024-01-19T04:31:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01ee830 con 0x7f8bb80047d0 2024-01-19T04:31:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bd51d3640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01eeb10 con 0x7f8bd00c0d30 2024-01-19T04:31:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bcf59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 0x7f8bd0141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bcf59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 0x7f8bd0141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44752/0 (socket says 172.21.15.133:44752) 2024-01-19T04:31:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.305+0000 7f8bcf59e640 1 -- 172.21.15.133:0/577755879 learned_addr learned my addr 172.21.15.133:0/577755879 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.309+0000 7f8bce59c640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd00c0d30 0x7f8bd01eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.309+0000 7f8bced9d640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb80047d0 0x7f8bd0143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.313+0000 7f8bcf59e640 1 -- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd00c0d30 msgr2=0x7f8bd01eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.313+0000 7f8bcf59e640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd00c0d30 0x7f8bd01eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.313+0000 7f8bcf59e640 1 -- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb80047d0 msgr2=0x7f8bd0143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.313+0000 7f8bcf59e640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb80047d0 0x7f8bd0143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.313+0000 7f8bcf59e640 1 -- 172.21.15.133:0/577755879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd01eedf0 con 0x7f8bd01eb860 2024-01-19T04:31:51.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.313+0000 7f8bcf59e640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 0x7f8bd0141670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0155090 tx=0x7f8bc800fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.317+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800d810 con 0x7f8bd01eb860 2024-01-19T04:31:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.317+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800d970 con 0x7f8bd01eb860 2024-01-19T04:31:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.317+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800dd20 con 0x7f8bd01eb860 2024-01-19T04:31:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.317+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd01ef0d0 con 0x7f8bd01eb860 2024-01-19T04:31:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.321+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd00c0090 con 0x7f8bd01eb860 2024-01-19T04:31:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.321+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0071fa0 con 0x7f8bd01eb860 2024-01-19T04:31:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.337+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8bc801f3b0 con 0x7f8bd01eb860 2024-01-19T04:31:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.337+0000 7f8bb77fe640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8bbc066550 0x7f8bbc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.341+0000 7f8bced9d640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8bbc066550 0x7f8bbc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.341+0000 7f8bced9d640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8bbc066550 0x7f8bbc068a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009c60 tx=0x7f8bc0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:51.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.341+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8bc800de80 con 0x7f8bd01eb860 2024-01-19T04:31:51.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.605+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8bc8057920 con 0x7f8bd01eb860 2024-01-19T04:31:51.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.765+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bd0074340 con 0x7f8bd01eb860 2024-01-19T04:31:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bb77fe640 1 -- 172.21.15.133:0/577755879 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f8bc801b020 con 0x7f8bd01eb860 2024-01-19T04:31:51.817 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:51.817 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8bbc066550 msgr2=0x7f8bbc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8bbc066550 0x7f8bbc068a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009c60 tx=0x7f8bc0009190 comp rx=0 tx=0).stop 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 msgr2=0x7f8bd0141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 0x7f8bd0141670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0155090 tx=0x7f8bc800fb90 comp rx=0 tx=0).stop 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 shutdown_connections 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8bbc066550 0x7f8bbc068a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bd01eb860 0x7f8bd0141670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd00c0d30 0x7f8bd01eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 --2- 172.21.15.133:0/577755879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb80047d0 0x7f8bd0143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 >> 172.21.15.133:0/577755879 conn(0x7f8bd006d590 msgr2=0x7f8bd0144cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 shutdown_connections 2024-01-19T04:31:51.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.817+0000 7f8bd51d3640 1 -- 172.21.15.133:0/577755879 wait complete. 2024-01-19T04:31:51.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:31:30.230778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:31:31.446896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-19T04:31:37.539878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-19T04:31:51.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:31:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.969+0000 7f51a5ea3640 1 Processor -- start 2024-01-19T04:31:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.969+0000 7f51a5ea3640 1 -- start start 2024-01-19T04:31:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f51a5ea3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51a00c7f30 0x7f51a006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f51a5ea3640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f51a5ea3640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a015a9d0 con 0x7f51a006dfd0 2024-01-19T04:31:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f51a5ea3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a01573e0 con 0x7f51a00c7f30 2024-01-19T04:31:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f51a5ea3640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a01576a0 con 0x7f51a01518a0 2024-01-19T04:31:51.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f519f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51a00c7f30 0x7f51a006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f519f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51a00c7f30 0x7f51a006da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44764/0 (socket says 172.21.15.133:44764) 2024-01-19T04:31:51.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f519f7fe640 1 -- 172.21.15.133:0/664106316 learned_addr learned my addr 172.21.15.133:0/664106316 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:51.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.973+0000 7f519ffff640 1 --2- 172.21.15.133:0/664106316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.977+0000 7f519f7fe640 1 -- 172.21.15.133:0/664106316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 msgr2=0x7f51a015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:51.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.977+0000 7f519f7fe640 1 --2- 172.21.15.133:0/664106316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a015ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.977+0000 7f519f7fe640 1 -- 172.21.15.133:0/664106316 >> v1:172.21.15.156:6789/0 conn(0x7f51a006dfd0 legacy=0x7f51a0151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:51.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.977+0000 7f519f7fe640 1 -- 172.21.15.133:0/664106316 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0157980 con 0x7f51a00c7f30 2024-01-19T04:31:51.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.981+0000 7f519f7fe640 1 --2- 172.21.15.133:0/664106316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a00c7f30 0x7f51a006da90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51900098a0 tx=0x7f519001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f621a0f9db1c44df server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:51.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f519e7fc640 1 -- 172.21.15.133:0/664106316 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900a8990 con 0x7f51a00c7f30 2024-01-19T04:31:51.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f519e7fc640 1 -- 172.21.15.133:0/664106316 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900a8af0 con 0x7f51a00c7f30 2024-01-19T04:31:51.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f519e7fc640 1 -- 172.21.15.133:0/664106316 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900a8e80 con 0x7f51a00c7f30 2024-01-19T04:31:51.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 -- 172.21.15.133:0/664106316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a00c7f30 msgr2=0x7f51a006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/664106316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a00c7f30 0x7f51a006da90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51900098a0 tx=0x7f519001ecd0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 -- 172.21.15.133:0/664106316 shutdown_connections 2024-01-19T04:31:51.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/664106316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/664106316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a00c7f30 0x7f51a006da90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 -- 172.21.15.133:0/664106316 >> 172.21.15.133:0/664106316 conn(0x7f51a006aa60 msgr2=0x7f51a006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:51.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 -- 172.21.15.133:0/664106316 shutdown_connections 2024-01-19T04:31:51.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 -- 172.21.15.133:0/664106316 wait complete. 2024-01-19T04:31:51.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 Processor -- start 2024-01-19T04:31:51.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.989+0000 7f51a5ea3640 1 -- start start 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f51a5ea3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 0x7f51a0144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f51a5ea3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a00c7f30 0x7f51a01ee410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f51a5ea3640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a0141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f51a5ea3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0150cb0 con 0x7f51a006dfd0 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f51a5ea3640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00c1970 con 0x7f51a00c7f30 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f51a5ea3640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00c0bb0 con 0x7f51a01518a0 2024-01-19T04:31:51.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f519f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 0x7f51a0144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f519f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 0x7f51a0144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44774/0 (socket says 172.21.15.133:44774) 2024-01-19T04:31:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f519f7fe640 1 -- 172.21.15.133:0/632352420 learned_addr learned my addr 172.21.15.133:0/632352420 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.993+0000 7f519ffff640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a0141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:51.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.997+0000 7f519f7fe640 1 -- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 msgr2=0x7f51a0141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.997+0000 7f519f7fe640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a0141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.997+0000 7f519f7fe640 1 -- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a00c7f30 msgr2=0x7f51a01ee410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:51.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.997+0000 7f519f7fe640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a00c7f30 0x7f51a01ee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:51.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:51.997+0000 7f519f7fe640 1 -- 172.21.15.133:0/632352420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900094d0 con 0x7f51a006dfd0 2024-01-19T04:31:52.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.001+0000 7f519f7fe640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 0x7f51a0144d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51900b3040 tx=0x7f519001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.005+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900ba600 con 0x7f51a006dfd0 2024-01-19T04:31:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.005+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900ba760 con 0x7f51a006dfd0 2024-01-19T04:31:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.005+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900bab10 con 0x7f51a006dfd0 2024-01-19T04:31:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.005+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a00c0930 con 0x7f51a006dfd0 2024-01-19T04:31:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.005+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00c1320 con 0x7f51a006dfd0 2024-01-19T04:31:52.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.005+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a0074340 con 0x7f51a006dfd0 2024-01-19T04:31:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.325+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f51900bac70 con 0x7f51a006dfd0 2024-01-19T04:31:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.325+0000 7f5187fff640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f518c066580 0x7f518c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.325+0000 7f519effd640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f518c066580 0x7f518c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.329+0000 7f519effd640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f518c066580 0x7f518c068a40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5194007fd0 tx=0x7f51940079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:52.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.369+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51900f4500 con 0x7f51a006dfd0 2024-01-19T04:31:52.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.373+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f51900f0140 con 0x7f51a006dfd0 2024-01-19T04:31:52.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.549+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51a0074340 con 0x7f51a006dfd0 2024-01-19T04:31:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.577+0000 7f5187fff640 1 -- 172.21.15.133:0/632352420 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51900b5070 con 0x7f51a006dfd0 2024-01-19T04:31:52.581 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T04:31:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f518c066580 msgr2=0x7f518c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f518c066580 0x7f518c068a40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5194007fd0 tx=0x7f51940079a0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 msgr2=0x7f51a0144d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 0x7f51a0144d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51900b3040 tx=0x7f519001ba70 comp rx=0 tx=0).stop 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 shutdown_connections 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f518c066580 0x7f518c068a40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a00c7f30 0x7f51a01ee410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a01518a0 0x7f51a0141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 --2- 172.21.15.133:0/632352420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51a006dfd0 0x7f51a0144d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 >> 172.21.15.133:0/632352420 conn(0x7f51a006aa60 msgr2=0x7f51a0072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 shutdown_connections 2024-01-19T04:31:52.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.581+0000 7f51a5ea3640 1 -- 172.21.15.133:0/632352420 wait complete. 2024-01-19T04:31:52.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:31:52.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.725+0000 7f96b022c640 1 Processor -- start 2024-01-19T04:31:52.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.725+0000 7f96b022c640 1 -- start start 2024-01-19T04:31:52.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.729+0000 7f96b022c640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 0x7f96a8157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.729+0000 7f96b022c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a80c7500 con 0x7f96a80c7990 2024-01-19T04:31:52.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.729+0000 7f96b022c640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a8151b20 con 0x7f96a8151740 2024-01-19T04:31:52.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.729+0000 7f96b022c640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a806f190 con 0x7f96a80c5db0 2024-01-19T04:31:52.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.729+0000 7f96adfc8640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f96a8151740 0x7f96a806ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:60720/0 (socket says 172.21.15.133:60720) 2024-01-19T04:31:52.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.729+0000 7f96adfc8640 1 -- 172.21.15.133:0/3980620775 learned_addr learned my addr 172.21.15.133:0/3980620775 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.741+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228552424 0 0) 0x7f96a80c7500 con 0x7f96a80c7990 2024-01-19T04:31:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.741+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9694003530 con 0x7f96a80c7990 2024-01-19T04:31:52.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.741+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429814795 0 0) 0x7f96a8151b20 con 0x7f96a8151740 2024-01-19T04:31:52.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.741+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a80c7500 con 0x7f96a8151740 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598072115 0 0) 0x7f9694003530 con 0x7f96a80c7990 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 msgr2=0x7f96a8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 0x7f96a8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 >> v1:172.21.15.156:6789/0 conn(0x7f96a8151740 legacy=0x7f96a806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80c7e40 con 0x7f96a80c7990 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f96a4001a00 con 0x7f96a80c7990 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 >> v1:172.21.15.133:6789/0 conn(0x7f96a80c7990 legacy=0x7f96a806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 0x7f9694003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9694004160 0x7f96940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004e30 0x7f969400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a806f190 con 0x7f9694004160 2024-01-19T04:31:52.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940055b0 con 0x7f9694004e30 2024-01-19T04:31:52.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.745+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96940102e0 con 0x7f96a80c5db0 2024-01-19T04:31:52.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.749+0000 7f96ae7c9640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004e30 0x7f969400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.749+0000 7f96adfc8640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 0x7f9694003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.749+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9694004160 0x7f96940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.753+0000 7f96ad7c7640 1 -- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 msgr2=0x7f9694003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:52.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.753+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a80c5db0 0x7f9694003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.753+0000 7f96ad7c7640 1 -- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004e30 msgr2=0x7f969400fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:52.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.753+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004e30 0x7f969400fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.753+0000 7f96ad7c7640 1 -- 172.21.15.133:0/3980620775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694003530 con 0x7f9694004160 2024-01-19T04:31:52.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.757+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9694004160 0x7f96940047d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9698009860 tx=0x7f969801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d0ba05bd8846c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980ab600 con 0x7f9694004160 2024-01-19T04:31:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980a7050 con 0x7f9694004160 2024-01-19T04:31:52.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96acfc6640 1 -- 172.21.15.133:0/3980620775 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980aba00 con 0x7f9694004160 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 -- 172.21.15.133:0/3980620775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9694004160 msgr2=0x7f96940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 --2- 172.21.15.133:0/3980620775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9694004160 0x7f96940047d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9698009860 tx=0x7f969801c320 comp rx=0 tx=0).stop 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96ae7c9640 1 -- 172.21.15.133:0/3980620775 reap_dead start 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 -- 172.21.15.133:0/3980620775 shutdown_connections 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 -- 172.21.15.133:0/3980620775 >> 172.21.15.133:0/3980620775 conn(0x7f96a806b770 msgr2=0x7f96a806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 -- 172.21.15.133:0/3980620775 shutdown_connections 2024-01-19T04:31:52.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 -- 172.21.15.133:0/3980620775 wait complete. 2024-01-19T04:31:52.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 Processor -- start 2024-01-19T04:31:52.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.761+0000 7f96b022c640 1 -- start start 2024-01-19T04:31:52.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96b022c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004160 0x7f96a81ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96b022c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 0x7f96a81eead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96b022c640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a81ed470 0x7f96a81ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96b022c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a81ecfe0 con 0x7f96a814f2a0 2024-01-19T04:31:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96b022c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a8154d20 con 0x7f9694004160 2024-01-19T04:31:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96b022c640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a81ede30 con 0x7f96a81ed470 2024-01-19T04:31:52.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96ad7c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 0x7f96a81eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96ad7c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 0x7f96a81eead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56282/0 (socket says 172.21.15.133:56282) 2024-01-19T04:31:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96ad7c7640 1 -- 172.21.15.133:0/4071710685 learned_addr learned my addr 172.21.15.133:0/4071710685 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96ae7c9640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a81ed470 0x7f96a81ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.765+0000 7f96adfc8640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004160 0x7f96a81ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.769+0000 7f96ad7c7640 1 -- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a81ed470 msgr2=0x7f96a81ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.769+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a81ed470 0x7f96a81ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.769+0000 7f96ad7c7640 1 -- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004160 msgr2=0x7f96a81ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.769+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004160 0x7f96a81ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.769+0000 7f96ad7c7640 1 -- 172.21.15.133:0/4071710685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a81ec3d0 con 0x7f96a814f2a0 2024-01-19T04:31:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.769+0000 7f96ad7c7640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 0x7f96a81eead0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9698000c10 tx=0x7f9694005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.773+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980b5670 con 0x7f96a814f2a0 2024-01-19T04:31:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.773+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980b57d0 con 0x7f96a814f2a0 2024-01-19T04:31:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.773+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980b5b40 con 0x7f96a814f2a0 2024-01-19T04:31:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.773+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a81ec6b0 con 0x7f96a814f2a0 2024-01-19T04:31:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.773+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a81ecc70 con 0x7f96a814f2a0 2024-01-19T04:31:52.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.777+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a8074340 con 0x7f96a814f2a0 2024-01-19T04:31:52.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.793+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96980b2040 con 0x7f96a814f2a0 2024-01-19T04:31:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.793+0000 7f969e7fc640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f968c066550 0x7f968c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.793+0000 7f96adfc8640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f968c066550 0x7f968c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.797+0000 7f96adfc8640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f968c066550 0x7f968c068a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96a0004f10 tx=0x7f96a00048a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:52.797+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96980eed60 con 0x7f96a814f2a0 2024-01-19T04:31:53.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.057+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f96980eb0a0 con 0x7f96a814f2a0 2024-01-19T04:31:53.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.229+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96a80709f0 con 0x7f96a814f2a0 2024-01-19T04:31:53.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.241+0000 7f969e7fc640 1 -- 172.21.15.133:0/4071710685 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96980ee6c0 con 0x7f96a814f2a0 2024-01-19T04:31:53.242 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f968c066550 msgr2=0x7f968c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f968c066550 0x7f968c068a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96a0004f10 tx=0x7f96a00048a0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 msgr2=0x7f96a81eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 0x7f96a81eead0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9698000c10 tx=0x7f9694005800 comp rx=0 tx=0).stop 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 shutdown_connections 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f968c066550 0x7f968c068a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a81ed470 0x7f96a81ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96a814f2a0 0x7f96a81eead0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 --2- 172.21.15.133:0/4071710685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9694004160 0x7f96a81ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 >> 172.21.15.133:0/4071710685 conn(0x7f96a806b770 msgr2=0x7f96a80c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 shutdown_connections 2024-01-19T04:31:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.245+0000 7f96b022c640 1 -- 172.21.15.133:0/4071710685 wait complete. 2024-01-19T04:31:53.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:31:53.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.381+0000 7ff20aaed640 1 Processor -- start 2024-01-19T04:31:53.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.381+0000 7ff20aaed640 1 -- start start 2024-01-19T04:31:53.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff20aaed640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2040c9920 0x7ff2040c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff20aaed640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff20415a600 0x7ff20415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff20aaed640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2040cf9e0 0x7ff2040b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff20aaed640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff204159950 con 0x7ff2040c9920 2024-01-19T04:31:53.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff20aaed640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040c9420 con 0x7ff20415a600 2024-01-19T04:31:53.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff20aaed640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040ca240 con 0x7ff2040cf9e0 2024-01-19T04:31:53.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2040c9920 0x7ff2040c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:53.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2040c9920 0x7ff2040c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56296/0 (socket says 172.21.15.133:56296) 2024-01-19T04:31:53.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 -- 172.21.15.133:0/3999605301 learned_addr learned my addr 172.21.15.133:0/3999605301 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:53.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff203fff640 1 --2- 172.21.15.133:0/3999605301 >> v2:172.21.15.156:3300/0 conn(0x7ff20415a600 0x7ff20415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:53.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 -- 172.21.15.133:0/3999605301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2040cf9e0 msgr2=0x7ff2040b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:53.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 --2- 172.21.15.133:0/3999605301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2040cf9e0 0x7ff2040b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 -- 172.21.15.133:0/3999605301 >> v2:172.21.15.156:3300/0 conn(0x7ff20415a600 msgr2=0x7ff20415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:53.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 --2- 172.21.15.133:0/3999605301 >> v2:172.21.15.156:3300/0 conn(0x7ff20415a600 0x7ff20415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.385+0000 7ff208889640 1 -- 172.21.15.133:0/3999605301 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20415a170 con 0x7ff2040c9920 2024-01-19T04:31:53.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.393+0000 7ff208889640 1 --2- 172.21.15.133:0/3999605301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040c9920 0x7ff2040c9d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ccdb0 tx=0x7ff1ec01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5636cd23f6d21770 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:53.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff2037fe640 1 -- 172.21.15.133:0/3999605301 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec0a89b0 con 0x7ff2040c9920 2024-01-19T04:31:53.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff2037fe640 1 -- 172.21.15.133:0/3999605301 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec0a8b10 con 0x7ff2040c9920 2024-01-19T04:31:53.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff2037fe640 1 -- 172.21.15.133:0/3999605301 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec0a8ea0 con 0x7ff2040c9920 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 -- 172.21.15.133:0/3999605301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040c9920 msgr2=0x7ff2040c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 --2- 172.21.15.133:0/3999605301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040c9920 0x7ff2040c9d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ccdb0 tx=0x7ff1ec01ecf0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 -- 172.21.15.133:0/3999605301 shutdown_connections 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 --2- 172.21.15.133:0/3999605301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2040cf9e0 0x7ff2040b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 --2- 172.21.15.133:0/3999605301 >> v2:172.21.15.156:3300/0 conn(0x7ff20415a600 0x7ff20415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 --2- 172.21.15.133:0/3999605301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040c9920 0x7ff2040c9d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 -- 172.21.15.133:0/3999605301 >> 172.21.15.133:0/3999605301 conn(0x7ff20408afa0 msgr2=0x7ff20408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 -- 172.21.15.133:0/3999605301 shutdown_connections 2024-01-19T04:31:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 -- 172.21.15.133:0/3999605301 wait complete. 2024-01-19T04:31:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 Processor -- start 2024-01-19T04:31:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.397+0000 7ff20aaed640 1 -- start start 2024-01-19T04:31:53.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff20aaed640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2040c9920 0x7ff2041e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff20aaed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 0x7ff204152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff20aaed640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff20415a600 0x7ff2040c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff20aaed640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2041596d0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff20aaed640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2041e3710 con 0x7ff2040c9920 2024-01-19T04:31:53.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff20aaed640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2041eff00 con 0x7ff20415a600 2024-01-19T04:31:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff203fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 0x7ff204152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff203fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 0x7ff204152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56306/0 (socket says 172.21.15.133:56306) 2024-01-19T04:31:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff203fff640 1 -- 172.21.15.133:0/102658285 learned_addr learned my addr 172.21.15.133:0/102658285 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:53.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.401+0000 7ff208889640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2040c9920 0x7ff2041e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.405+0000 7ff20908a640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff20415a600 0x7ff2040c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.405+0000 7ff203fff640 1 -- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff20415a600 msgr2=0x7ff2040c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.405+0000 7ff203fff640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff20415a600 0x7ff2040c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.405+0000 7ff203fff640 1 -- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2040c9920 msgr2=0x7ff2041e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.405+0000 7ff203fff640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2040c9920 0x7ff2041e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.405+0000 7ff203fff640 1 -- 172.21.15.133:0/102658285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec0094d0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.409+0000 7ff203fff640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 0x7ff204152d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c820 tx=0x7ff1f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.413+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4004220 con 0x7ff2040cf9e0 2024-01-19T04:31:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.413+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f40043a0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.413+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4004510 con 0x7ff2040cf9e0 2024-01-19T04:31:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.413+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2041f01c0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.413+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2041e30c0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.413+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20406d7f0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.433+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff1f4007a70 con 0x7ff2040cf9e0 2024-01-19T04:31:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.433+0000 7ff2017fa640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff1e4066550 0x7ff1e4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.433+0000 7ff208889640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff1e4066550 0x7ff1e4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.433+0000 7ff208889640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff1e4066550 0x7ff1e4068a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0b2000 tx=0x7ff1ec0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:53.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.701+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff1f40556e0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.701+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff1f4051320 con 0x7ff2040cf9e0 2024-01-19T04:31:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.869+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff204074340 con 0x7ff2040cf9e0 2024-01-19T04:31:53.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.901+0000 7ff2017fa640 1 -- 172.21.15.133:0/102658285 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1f401e0a0 con 0x7ff2040cf9e0 2024-01-19T04:31:53.903 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-19T04:31:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff1e4066550 msgr2=0x7ff1e4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff1e4066550 0x7ff1e4068a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0b2000 tx=0x7ff1ec0aa070 comp rx=0 tx=0).stop 2024-01-19T04:31:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 msgr2=0x7ff204152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 0x7ff204152d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c820 tx=0x7ff1f400cce0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 shutdown_connections 2024-01-19T04:31:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff1e4066550 0x7ff1e4068a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff20415a600 0x7ff2040c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2040cf9e0 0x7ff204152d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 --2- 172.21.15.133:0/102658285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2040c9920 0x7ff2041e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 >> 172.21.15.133:0/102658285 conn(0x7ff20408afa0 msgr2=0x7ff20415ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 shutdown_connections 2024-01-19T04:31:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:53.905+0000 7ff20aaed640 1 -- 172.21.15.133:0/102658285 wait complete. 2024-01-19T04:31:53.923 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-19T04:31:54.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 Processor -- start 2024-01-19T04:31:54.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 -- start start 2024-01-19T04:31:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc0072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc00c7660 0x7f5dc015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00c3ac0 con 0x7f5dc00c7a80 2024-01-19T04:31:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc0072740 con 0x7f5dc00c7660 2024-01-19T04:31:54.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dc5296640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0072a00 con 0x7f5dc015cdb0 2024-01-19T04:31:54.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5db7fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc00c7660 0x7f5dc015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5dbeffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc0072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.045+0000 7f5db7fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc00c7660 0x7f5dc015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:59208/0 (socket says 172.21.15.133:59208) 2024-01-19T04:31:54.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.049+0000 7f5db7fff640 1 -- 172.21.15.133:0/1351137915 learned_addr learned my addr 172.21.15.133:0/1351137915 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.053+0000 7f5db7fff640 1 -- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 msgr2=0x7f5dc0072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.057+0000 7f5db7fff640 1 --2- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc0072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.057+0000 7f5db7fff640 1 -- 172.21.15.133:0/1351137915 >> v1:172.21.15.133:6789/0 conn(0x7f5dc00c7a80 legacy=0x7f5dc0153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.057+0000 7f5db7fff640 1 -- 172.21.15.133:0/1351137915 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00c68a0 con 0x7f5dc00c7660 2024-01-19T04:31:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.061+0000 7f5db7fff640 1 --2- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7660 0x7f5dc015d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009870 tx=0x7f5db001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64cff30b8d7cd37a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.189+0000 7f5dbe7fc640 1 -- 172.21.15.133:0/1351137915 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00aa5f0 con 0x7f5dc00c7660 2024-01-19T04:31:54.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.189+0000 7f5dbe7fc640 1 -- 172.21.15.133:0/1351137915 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db00aa750 con 0x7f5dc00c7660 2024-01-19T04:31:54.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.189+0000 7f5dbe7fc640 1 -- 172.21.15.133:0/1351137915 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00aaae0 con 0x7f5dc00c7660 2024-01-19T04:31:54.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 -- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7660 msgr2=0x7f5dc015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 --2- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7660 0x7f5dc015d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009870 tx=0x7f5db001c4d0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 -- 172.21.15.133:0/1351137915 shutdown_connections 2024-01-19T04:31:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 --2- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7660 0x7f5dc015d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 --2- 172.21.15.133:0/1351137915 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc0072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 -- 172.21.15.133:0/1351137915 >> 172.21.15.133:0/1351137915 conn(0x7f5dc00cb3e0 msgr2=0x7f5dc00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 -- 172.21.15.133:0/1351137915 shutdown_connections 2024-01-19T04:31:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 -- 172.21.15.133:0/1351137915 wait complete. 2024-01-19T04:31:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 Processor -- start 2024-01-19T04:31:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.193+0000 7f5dc5296640 1 -- start start 2024-01-19T04:31:54.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dc5296640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dc00c7660 0x7f5dc00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dc5296640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7a80 0x7f5dc0144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dc5296640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc01f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dc5296640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc015c530 con 0x7f5dc00c7660 2024-01-19T04:31:54.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dc5296640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc015c7f0 con 0x7f5dc00c7a80 2024-01-19T04:31:54.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dc5296640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc014b290 con 0x7f5dc015cdb0 2024-01-19T04:31:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dbf7fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc01f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5db7fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7a80 0x7f5dc0144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dbf7fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc01f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:50074/0 (socket says 172.21.15.133:50074) 2024-01-19T04:31:54.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.197+0000 7f5dbf7fe640 1 -- 172.21.15.133:0/2276050246 learned_addr learned my addr 172.21.15.133:0/2276050246 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.213+0000 7f5dbf7fe640 1 -- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7a80 msgr2=0x7f5dc0144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.213+0000 7f5dbf7fe640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7a80 0x7f5dc0144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.213+0000 7f5dbf7fe640 1 -- 172.21.15.133:0/2276050246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dc00c7660 msgr2=0x7f5dc00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.213+0000 7f5dbf7fe640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dc00c7660 0x7f5dc00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.213+0000 7f5dbf7fe640 1 -- 172.21.15.133:0/2276050246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00094d0 con 0x7f5dc015cdb0 2024-01-19T04:31:54.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.221+0000 7f5dbf7fe640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc01f1fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c780 tx=0x7f5db800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.229+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8003d90 con 0x7f5dc015cdb0 2024-01-19T04:31:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.229+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800ce30 con 0x7f5dc015cdb0 2024-01-19T04:31:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.229+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8005290 con 0x7f5dc015cdb0 2024-01-19T04:31:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.229+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc014b570 con 0x7f5dc015cdb0 2024-01-19T04:31:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.229+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc014af90 con 0x7f5dc015cdb0 2024-01-19T04:31:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.233+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0074340 con 0x7f5dc015cdb0 2024-01-19T04:31:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.569+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5db80053f0 con 0x7f5dc015cdb0 2024-01-19T04:31:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.569+0000 7f5db77fe640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5da4066580 0x7f5da4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.569+0000 7f5dbeffd640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5da4066580 0x7f5da4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.573+0000 7f5dbeffd640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5da4066580 0x7f5da4068a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5da8006aa0 tx=0x7f5da8006a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:54.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.577+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5db8054ad0 con 0x7f5dc015cdb0 2024-01-19T04:31:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.609+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5db8050e10 con 0x7f5dc015cdb0 2024-01-19T04:31:54.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.773+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5dc014b3d0 con 0x7f5dc015cdb0 2024-01-19T04:31:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.793+0000 7f5db77fe640 1 -- 172.21.15.133:0/2276050246 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5dc014b3d0 con 0x7f5dc015cdb0 2024-01-19T04:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5da4066580 msgr2=0x7f5da4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5da4066580 0x7f5da4068a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5da8006aa0 tx=0x7f5da8006a30 comp rx=0 tx=0).stop 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 msgr2=0x7f5dc01f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc01f1fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c780 tx=0x7f5db800cc40 comp rx=0 tx=0).stop 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 shutdown_connections 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5da4066580 0x7f5da4068a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc00c7a80 0x7f5dc0144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc015cdb0 0x7f5dc01f1fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 --2- 172.21.15.133:0/2276050246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dc00c7660 0x7f5dc00cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 >> 172.21.15.133:0/2276050246 conn(0x7f5dc00cb3e0 msgr2=0x7f5dc00c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 shutdown_connections 2024-01-19T04:31:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.797+0000 7f5dc5296640 1 -- 172.21.15.133:0/2276050246 wait complete. 2024-01-19T04:31:54.814 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:31:54.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 Processor -- start 2024-01-19T04:31:54.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 -- start start 2024-01-19T04:31:54.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b980c4ea0 0x7f9b9806a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9b9806b8b0 0x7f9b9815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b980c5280 0x7f9b9815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b980c8ea0 con 0x7f9b980c4ea0 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9806bd40 con 0x7f9b9806b8b0 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9ba02c3640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980c88e0 con 0x7f9b980c5280 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9b9e05f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b980c4ea0 0x7f9b9806a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9b9e05f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b980c4ea0 0x7f9b9806a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56316/0 (socket says 172.21.15.133:56316) 2024-01-19T04:31:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.925+0000 7f9b9e05f640 1 -- 172.21.15.133:0/132243011 learned_addr learned my addr 172.21.15.133:0/132243011 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.929+0000 7f9b9e05f640 1 -- 172.21.15.133:0/132243011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b980c5280 msgr2=0x7f9b9815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.929+0000 7f9b9e05f640 1 --2- 172.21.15.133:0/132243011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b980c5280 0x7f9b9815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.929+0000 7f9b9e05f640 1 -- 172.21.15.133:0/132243011 >> v2:172.21.15.156:3300/0 conn(0x7f9b9806b8b0 msgr2=0x7f9b9815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.929+0000 7f9b9e05f640 1 --2- 172.21.15.133:0/132243011 >> v2:172.21.15.156:3300/0 conn(0x7f9b9806b8b0 0x7f9b9815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.929+0000 7f9b9e05f640 1 -- 172.21.15.133:0/132243011 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980c8bc0 con 0x7f9b980c4ea0 2024-01-19T04:31:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.933+0000 7f9b9e05f640 1 --2- 172.21.15.133:0/132243011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c4ea0 0x7f9b9806a660 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b980b7550 tx=0x7f9b9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d442eca39bbb79 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9b9d05d640 1 -- 172.21.15.133:0/132243011 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900ab670 con 0x7f9b980c4ea0 2024-01-19T04:31:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9b9d05d640 1 -- 172.21.15.133:0/132243011 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900ab7d0 con 0x7f9b980c4ea0 2024-01-19T04:31:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9b9d05d640 1 -- 172.21.15.133:0/132243011 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900abb60 con 0x7f9b980c4ea0 2024-01-19T04:31:54.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 -- 172.21.15.133:0/132243011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c4ea0 msgr2=0x7f9b9806a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/132243011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c4ea0 0x7f9b9806a660 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b980b7550 tx=0x7f9b9001c4d0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 -- 172.21.15.133:0/132243011 shutdown_connections 2024-01-19T04:31:54.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/132243011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b980c5280 0x7f9b9815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/132243011 >> v2:172.21.15.156:3300/0 conn(0x7f9b9806b8b0 0x7f9b9815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/132243011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c4ea0 0x7f9b9806a660 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 -- 172.21.15.133:0/132243011 >> 172.21.15.133:0/132243011 conn(0x7f9b9806fa20 msgr2=0x7f9b980c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 -- 172.21.15.133:0/132243011 shutdown_connections 2024-01-19T04:31:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 -- 172.21.15.133:0/132243011 wait complete. 2024-01-19T04:31:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 Processor -- start 2024-01-19T04:31:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.937+0000 7f9ba02c3640 1 -- start start 2024-01-19T04:31:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9ba02c3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b980c4ea0 0x7f9b981445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9ba02c3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 0x7f9b980caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9ba02c3640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b98142960 0x7f9b98136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9ba02c3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981442e0 con 0x7f9b980c5280 2024-01-19T04:31:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9ba02c3640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981f43a0 con 0x7f9b980c4ea0 2024-01-19T04:31:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9ba02c3640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981f4c40 con 0x7f9b98142960 2024-01-19T04:31:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9b9d85e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 0x7f9b980caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9b9d85e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 0x7f9b980caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56332/0 (socket says 172.21.15.133:56332) 2024-01-19T04:31:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9b9d85e640 1 -- 172.21.15.133:0/2740493060 learned_addr learned my addr 172.21.15.133:0/2740493060 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.941+0000 7f9b9e860640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b98142960 0x7f9b98136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:54.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.945+0000 7f9b9d85e640 1 -- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b98142960 msgr2=0x7f9b98136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.945+0000 7f9b9d85e640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b98142960 0x7f9b98136c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.945+0000 7f9b9d85e640 1 -- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b980c4ea0 msgr2=0x7f9b981445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:54.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.945+0000 7f9b9d85e640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b980c4ea0 0x7f9b981445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:54.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.945+0000 7f9b9d85e640 1 -- 172.21.15.133:0/2740493060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900094d0 con 0x7f9b980c5280 2024-01-19T04:31:54.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.945+0000 7f9b9d85e640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 0x7f9b980caaf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400b9c0 tx=0x7f9b9400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:54.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.957+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94018440 con 0x7f9b980c5280 2024-01-19T04:31:54.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.957+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b940185c0 con 0x7f9b980c5280 2024-01-19T04:31:54.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.957+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94018970 con 0x7f9b980c5280 2024-01-19T04:31:54.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.957+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b98156f60 con 0x7f9b980c5280 2024-01-19T04:31:54.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.957+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b981f45f0 con 0x7f9b980c5280 2024-01-19T04:31:54.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:54.957+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b980c7020 con 0x7f9b980c5280 2024-01-19T04:31:55.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.233+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9b940213b0 con 0x7f9b980c5280 2024-01-19T04:31:55.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.233+0000 7f9b8affd640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9b7c066580 0x7f9b7c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.237+0000 7f9b9e05f640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9b7c066580 0x7f9b7c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.237+0000 7f9b9e05f640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9b7c066580 0x7f9b7c068a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b900af000 tx=0x7f9b90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:55.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.273+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b940595b0 con 0x7f9b980c5280 2024-01-19T04:31:55.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.273+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9b940558f0 con 0x7f9b980c5280 2024-01-19T04:31:55.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.449+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9b98074340 con 0x7f9b980c5280 2024-01-19T04:31:55.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9b8affd640 1 -- 172.21.15.133:0/2740493060 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9b9401d020 con 0x7f9b980c5280 2024-01-19T04:31:55.469 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-01-19T04:31:55.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9b7c066580 msgr2=0x7f9b7c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9b7c066580 0x7f9b7c068a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b900af000 tx=0x7f9b90008040 comp rx=0 tx=0).stop 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 msgr2=0x7f9b980caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 0x7f9b980caaf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400b9c0 tx=0x7f9b9400be80 comp rx=0 tx=0).stop 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 shutdown_connections 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9b7c066580 0x7f9b7c068a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b98142960 0x7f9b98136c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b980c5280 0x7f9b980caaf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 --2- 172.21.15.133:0/2740493060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b980c4ea0 0x7f9b981445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 >> 172.21.15.133:0/2740493060 conn(0x7f9b9806fa20 msgr2=0x7f9b9813af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 shutdown_connections 2024-01-19T04:31:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.469+0000 7f9ba02c3640 1 -- 172.21.15.133:0/2740493060 wait complete. 2024-01-19T04:31:55.490 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:31:55.490 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:31:55.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:31:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.677+0000 7f02990f1640 1 Processor -- start 2024-01-19T04:31:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.677+0000 7f02990f1640 1 -- start start 2024-01-19T04:31:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f02990f1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0294151600 0x7f029415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f02990f1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02941519e0 0x7f02940c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f02990f1640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f029406f350 0x7f0294157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f02990f1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0294158390 con 0x7f0294151600 2024-01-19T04:31:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f02990f1640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029415b0e0 con 0x7f029406f350 2024-01-19T04:31:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f02990f1640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0294157dd0 con 0x7f02941519e0 2024-01-19T04:31:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f0292d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0294151600 0x7f029415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f0292d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0294151600 0x7f029415b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56344/0 (socket says 172.21.15.133:56344) 2024-01-19T04:31:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f0292d9d640 1 -- 172.21.15.133:0/3124875605 learned_addr learned my addr 172.21.15.133:0/3124875605 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f029259c640 1 --2- 172.21.15.133:0/3124875605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02941519e0 0x7f02940c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.681+0000 7f029359e640 1 --2- 172.21.15.133:0/3124875605 >> v2:172.21.15.156:3300/0 conn(0x7f029406f350 0x7f0294157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.685+0000 7f0292d9d640 1 -- 172.21.15.133:0/3124875605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02941519e0 msgr2=0x7f02940c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.685+0000 7f0292d9d640 1 --2- 172.21.15.133:0/3124875605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02941519e0 0x7f02940c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.685+0000 7f0292d9d640 1 -- 172.21.15.133:0/3124875605 >> v2:172.21.15.156:3300/0 conn(0x7f029406f350 msgr2=0x7f0294157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.685+0000 7f0292d9d640 1 --2- 172.21.15.133:0/3124875605 >> v2:172.21.15.156:3300/0 conn(0x7f029406f350 0x7f0294157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.685+0000 7f0292d9d640 1 -- 172.21.15.133:0/3124875605 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02941580b0 con 0x7f0294151600 2024-01-19T04:31:55.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.689+0000 7f0292d9d640 1 --2- 172.21.15.133:0/3124875605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f029415b570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f02940c8c60 tx=0x7f028801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fedfe0263c80ccf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:55.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.689+0000 7f0291d9b640 1 -- 172.21.15.133:0/3124875605 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02880ac410 con 0x7f0294151600 2024-01-19T04:31:55.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f0291d9b640 1 -- 172.21.15.133:0/3124875605 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02880ac570 con 0x7f0294151600 2024-01-19T04:31:55.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f0291d9b640 1 -- 172.21.15.133:0/3124875605 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02880ac900 con 0x7f0294151600 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 -- 172.21.15.133:0/3124875605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 msgr2=0x7f029415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 --2- 172.21.15.133:0/3124875605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f029415b570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f02940c8c60 tx=0x7f028801c500 comp rx=0 tx=0).stop 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 -- 172.21.15.133:0/3124875605 shutdown_connections 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 --2- 172.21.15.133:0/3124875605 >> v2:172.21.15.156:3300/0 conn(0x7f029406f350 0x7f0294157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 --2- 172.21.15.133:0/3124875605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02941519e0 0x7f02940c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 --2- 172.21.15.133:0/3124875605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f029415b570 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 -- 172.21.15.133:0/3124875605 >> 172.21.15.133:0/3124875605 conn(0x7f029406d590 msgr2=0x7f0294066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 -- 172.21.15.133:0/3124875605 shutdown_connections 2024-01-19T04:31:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.693+0000 7f02990f1640 1 -- 172.21.15.133:0/3124875605 wait complete. 2024-01-19T04:31:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 Processor -- start 2024-01-19T04:31:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 -- start start 2024-01-19T04:31:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029406f350 0x7f02941f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f0294141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02940ca240 0x7f02941438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294144c80 con 0x7f0294151600 2024-01-19T04:31:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02941f2a70 con 0x7f029406f350 2024-01-19T04:31:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f02990f1640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0294144ed0 con 0x7f02940ca240 2024-01-19T04:31:55.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f029259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f0294141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f029259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f0294141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56358/0 (socket says 172.21.15.133:56358) 2024-01-19T04:31:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f029259c640 1 -- 172.21.15.133:0/147335459 learned_addr learned my addr 172.21.15.133:0/147335459 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f0292d9d640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029406f350 0x7f02941f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.697+0000 7f029359e640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02940ca240 0x7f02941438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.701+0000 7f029259c640 1 -- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02940ca240 msgr2=0x7f02941438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.701+0000 7f029259c640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02940ca240 0x7f02941438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.701+0000 7f029259c640 1 -- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029406f350 msgr2=0x7f02941f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.701+0000 7f029259c640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029406f350 0x7f02941f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:55.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.701+0000 7f029259c640 1 -- 172.21.15.133:0/147335459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880094d0 con 0x7f0294151600 2024-01-19T04:31:55.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.701+0000 7f029259c640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f0294141da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f028400d5f0 tx=0x7f028400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:55.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.705+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840125f0 con 0x7f0294151600 2024-01-19T04:31:55.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.705+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284012750 con 0x7f0294151600 2024-01-19T04:31:55.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.705+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284012ae0 con 0x7f0294151600 2024-01-19T04:31:55.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.705+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02941f2420 con 0x7f0294151600 2024-01-19T04:31:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.705+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029414c100 con 0x7f0294151600 2024-01-19T04:31:55.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.709+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0294070ee0 con 0x7f0294151600 2024-01-19T04:31:55.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.997+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0284012c40 con 0x7f0294151600 2024-01-19T04:31:55.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.997+0000 7f027b7fe640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0280066580 0x7f0280068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:55.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.997+0000 7f0292d9d640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0280066580 0x7f0280068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:56.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:55.997+0000 7f0292d9d640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0280066580 0x7f0280068a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02880ae000 tx=0x7f0288009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.081+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0284055c20 con 0x7f0294151600 2024-01-19T04:31:56.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.081+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0284051f60 con 0x7f0294151600 2024-01-19T04:31:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.285+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0294074340 con 0x7f0294151600 2024-01-19T04:31:56.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.377+0000 7f027b7fe640 1 -- 172.21.15.133:0/147335459 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f0284055580 con 0x7f0294151600 2024-01-19T04:31:56.380 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:31:56.380 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:31:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0280066580 msgr2=0x7f0280068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0280066580 0x7f0280068a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02880ae000 tx=0x7f0288009040 comp rx=0 tx=0).stop 2024-01-19T04:31:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 msgr2=0x7f0294141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f0294141da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f028400d5f0 tx=0x7f028400dab0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 shutdown_connections 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0280066580 0x7f0280068a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02940ca240 0x7f02941438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294151600 0x7f0294141da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 --2- 172.21.15.133:0/147335459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029406f350 0x7f02941f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 >> 172.21.15.133:0/147335459 conn(0x7f029406d590 msgr2=0x7f029414e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 shutdown_connections 2024-01-19T04:31:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.381+0000 7f02990f1640 1 -- 172.21.15.133:0/147335459 wait complete. 2024-01-19T04:31:56.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:31:30.230778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:31:31.446896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-19T04:31:37.539878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-19T04:31:56.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:31:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e8145640 1 Processor -- start 2024-01-19T04:31:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e8145640 1 -- start start 2024-01-19T04:31:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e8145640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f29e00c1770 0x7f29e0164f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e8145640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e006de40 con 0x7f29e0156bc0 2024-01-19T04:31:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e8145640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e0072130 con 0x7f29e00c83e0 2024-01-19T04:31:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e8145640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00bff60 con 0x7f29e00c1770 2024-01-19T04:31:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e5ee1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f29e0156bc0 0x7f29e00c7cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38814/0 (socket says 172.21.15.133:38814) 2024-01-19T04:31:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e5ee1640 1 -- 172.21.15.133:0/800577742 learned_addr learned my addr 172.21.15.133:0/800577742 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.533+0000 7f29e66e2640 1 --2- 172.21.15.133:0/800577742 >> v2:172.21.15.156:3300/0 conn(0x7f29e00c1770 0x7f29e0164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:56.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.537+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391645582 0 0) 0x7f29e006de40 con 0x7f29e0156bc0 2024-01-19T04:31:56.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.537+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c8003530 con 0x7f29e0156bc0 2024-01-19T04:31:56.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334760802 0 0) 0x7f29c8003530 con 0x7f29e0156bc0 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 >> v2:172.21.15.156:3300/0 conn(0x7f29e00c1770 msgr2=0x7f29e0164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 --2- 172.21.15.133:0/800577742 >> v2:172.21.15.156:3300/0 conn(0x7f29e00c1770 0x7f29e0164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 >> v1:172.21.15.156:6789/0 conn(0x7f29e00c83e0 legacy=0x7f29e015cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e006e0e0 con 0x7f29e0156bc0 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f29d0001a00 con 0x7f29e0156bc0 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 >> v1:172.21.15.133:6789/0 conn(0x7f29e0156bc0 legacy=0x7f29e00c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c8003a40 0x7f29c8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29c80051e0 0x7f29c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00bff60 con 0x7f29c80047d0 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c800c110 con 0x7f29c8003a40 2024-01-19T04:31:56.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c800c2d0 con 0x7f29c80051e0 2024-01-19T04:31:56.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.541+0000 7f29e56e0640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.545+0000 7f29e56e0640 1 -- 172.21.15.133:0/800577742 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29c80051e0 msgr2=0x7f29c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.545+0000 7f29e56e0640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29c80051e0 0x7f29c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.545+0000 7f29e56e0640 1 -- 172.21.15.133:0/800577742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c8003a40 msgr2=0x7f29c8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.545+0000 7f29e56e0640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c8003a40 0x7f29c8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.545+0000 7f29e56e0640 1 -- 172.21.15.133:0/800577742 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c8003530 con 0x7f29c80047d0 2024-01-19T04:31:56.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.545+0000 7f29e66e2640 1 -- 172.21.15.133:0/800577742 reap_dead start 2024-01-19T04:31:56.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.549+0000 7f29e56e0640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29c8004c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001780 tx=0x7f29d401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4342fdd6bd2c51 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40052d0 con 0x7f29c80047d0 2024-01-19T04:31:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d40a7050 con 0x7f29c80047d0 2024-01-19T04:31:56.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e4edf640 1 -- 172.21.15.133:0/800577742 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4003840 con 0x7f29c80047d0 2024-01-19T04:31:56.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 -- 172.21.15.133:0/800577742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 msgr2=0x7f29c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29c8004c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001780 tx=0x7f29d401c3e0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 -- 172.21.15.133:0/800577742 shutdown_connections 2024-01-19T04:31:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 --2- 172.21.15.133:0/800577742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29c8004c50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 -- 172.21.15.133:0/800577742 >> 172.21.15.133:0/800577742 conn(0x7f29e006aa60 msgr2=0x7f29e006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 -- 172.21.15.133:0/800577742 shutdown_connections 2024-01-19T04:31:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.553+0000 7f29e8145640 1 -- 172.21.15.133:0/800577742 wait complete. 2024-01-19T04:31:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 Processor -- start 2024-01-19T04:31:56.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 -- start start 2024-01-19T04:31:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29e00ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e00add90 0x7f29e01f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29e01f2eb0 0x7f29e0143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00af560 con 0x7f29c80047d0 2024-01-19T04:31:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00ac880 con 0x7f29e00add90 2024-01-19T04:31:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e8145640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00acb60 con 0x7f29e01f2eb0 2024-01-19T04:31:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e5ee1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29e00ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e5ee1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29e00ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56374/0 (socket says 172.21.15.133:56374) 2024-01-19T04:31:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e5ee1640 1 -- 172.21.15.133:0/3047851009 learned_addr learned my addr 172.21.15.133:0/3047851009 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.557+0000 7f29e56e0640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e00add90 0x7f29e01f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.561+0000 7f29e5ee1640 1 -- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29e01f2eb0 msgr2=0x7f29e0143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.561+0000 7f29e5ee1640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29e01f2eb0 0x7f29e0143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.561+0000 7f29e5ee1640 1 -- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e00add90 msgr2=0x7f29e01f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.561+0000 7f29e5ee1640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e00add90 0x7f29e01f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:56.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.561+0000 7f29e5ee1640 1 -- 172.21.15.133:0/3047851009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00ae5a0 con 0x7f29c80047d0 2024-01-19T04:31:56.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.561+0000 7f29e5ee1640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29e00ca0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29d0005c30 tx=0x7f29d000ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:56.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.565+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000db50 con 0x7f29c80047d0 2024-01-19T04:31:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.565+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d000dcd0 con 0x7f29c80047d0 2024-01-19T04:31:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.565+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e00ae880 con 0x7f29c80047d0 2024-01-19T04:31:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.565+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000a310 con 0x7f29c80047d0 2024-01-19T04:31:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.569+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e0158390 con 0x7f29c80047d0 2024-01-19T04:31:56.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.569+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0070f20 con 0x7f29c80047d0 2024-01-19T04:31:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.589+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f29d000a470 con 0x7f29c80047d0 2024-01-19T04:31:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.589+0000 7f29de7fc640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f29cc066580 0x7f29cc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.589+0000 7f29e56e0640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f29cc066580 0x7f29cc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.593+0000 7f29e56e0640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f29cc066580 0x7f29cc068a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001750 tx=0x7f29d40011a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.593+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29d000de40 con 0x7f29c80047d0 2024-01-19T04:31:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:56.857+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f29d0054330 con 0x7f29c80047d0 2024-01-19T04:31:57.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.029+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29e00aeac0 con 0x7f29c80047d0 2024-01-19T04:31:57.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.033+0000 7f29de7fc640 1 -- 172.21.15.133:0/3047851009 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29d001b020 con 0x7f29c80047d0 2024-01-19T04:31:57.036 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T04:31:57.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f29cc066580 msgr2=0x7f29cc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f29cc066580 0x7f29cc068a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001750 tx=0x7f29d40011a0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 msgr2=0x7f29e00ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29e00ca0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29d0005c30 tx=0x7f29d000ff00 comp rx=0 tx=0).stop 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 shutdown_connections 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f29cc066580 0x7f29cc068a40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e00add90 0x7f29e01f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f29e01f2eb0 0x7f29e0143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 --2- 172.21.15.133:0/3047851009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c80047d0 0x7f29e00ca0d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 >> 172.21.15.133:0/3047851009 conn(0x7f29e006aa60 msgr2=0x7f29e0154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 shutdown_connections 2024-01-19T04:31:57.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.037+0000 7f29e8145640 1 -- 172.21.15.133:0/3047851009 wait complete. 2024-01-19T04:31:57.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:31:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 Processor -- start 2024-01-19T04:31:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 -- start start 2024-01-19T04:31:57.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4140c7660 0x7fa41415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415d6d0 0x7fa414153170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140c3ac0 con 0x7fa41415cdb0 2024-01-19T04:31:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa414072a00 con 0x7fa4140c7660 2024-01-19T04:31:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.177+0000 7fa41a575640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c68a0 con 0x7fa41415d6d0 2024-01-19T04:31:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.181+0000 7fa418b12640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415d6d0 0x7fa414153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.181+0000 7fa413fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa41415cdb0 0x7fa414072200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38820/0 (socket says 172.21.15.133:38820) 2024-01-19T04:31:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.181+0000 7fa413fff640 1 -- 172.21.15.133:0/1628937692 learned_addr learned my addr 172.21.15.133:0/1628937692 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.181+0000 7fa4137fe640 1 --2- 172.21.15.133:0/1628937692 >> v2:172.21.15.156:3300/0 conn(0x7fa4140c7660 0x7fa41415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.189+0000 7fa418b12640 1 -- 172.21.15.133:0/1628937692 >> v2:172.21.15.156:3300/0 conn(0x7fa4140c7660 msgr2=0x7fa41415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.189+0000 7fa418b12640 1 --2- 172.21.15.133:0/1628937692 >> v2:172.21.15.156:3300/0 conn(0x7fa4140c7660 0x7fa41415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.189+0000 7fa418b12640 1 -- 172.21.15.133:0/1628937692 >> v1:172.21.15.133:6789/0 conn(0x7fa41415cdb0 legacy=0x7fa414072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.189+0000 7fa418b12640 1 -- 172.21.15.133:0/1628937692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140c6b80 con 0x7fa41415d6d0 2024-01-19T04:31:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.193+0000 7fa418b12640 1 --2- 172.21.15.133:0/1628937692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415d6d0 0x7fa414153170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0097c0 tx=0x7fa3fc01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8ea957a7e4fafc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.205+0000 7fa412ffd640 1 -- 172.21.15.133:0/1628937692 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0ac630 con 0x7fa41415d6d0 2024-01-19T04:31:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.205+0000 7fa412ffd640 1 -- 172.21.15.133:0/1628937692 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc0ac790 con 0x7fa41415d6d0 2024-01-19T04:31:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.205+0000 7fa412ffd640 1 -- 172.21.15.133:0/1628937692 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0acb20 con 0x7fa41415d6d0 2024-01-19T04:31:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- 172.21.15.133:0/1628937692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415d6d0 msgr2=0x7fa414153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 --2- 172.21.15.133:0/1628937692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415d6d0 0x7fa414153170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0097c0 tx=0x7fa3fc01c410 comp rx=0 tx=0).stop 2024-01-19T04:31:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- 172.21.15.133:0/1628937692 shutdown_connections 2024-01-19T04:31:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 --2- 172.21.15.133:0/1628937692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415d6d0 0x7fa414153170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 --2- 172.21.15.133:0/1628937692 >> v2:172.21.15.156:3300/0 conn(0x7fa4140c7660 0x7fa41415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- 172.21.15.133:0/1628937692 >> 172.21.15.133:0/1628937692 conn(0x7fa4140cb3e0 msgr2=0x7fa4140cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- 172.21.15.133:0/1628937692 shutdown_connections 2024-01-19T04:31:57.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- 172.21.15.133:0/1628937692 wait complete. 2024-01-19T04:31:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 Processor -- start 2024-01-19T04:31:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- start start 2024-01-19T04:31:57.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4140c7660 0x7fa4140cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:57.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415cdb0 0x7fa4140ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:57.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 0x7fa4141f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:57.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140cbd60 con 0x7fa4140c7660 2024-01-19T04:31:57.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41414e200 con 0x7fa41415d6d0 2024-01-19T04:31:57.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.209+0000 7fa41a575640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41414d190 con 0x7fa41415cdb0 2024-01-19T04:31:57.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.213+0000 7fa418b12640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 0x7fa4141f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.217+0000 7fa418b12640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 0x7fa4141f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:59312/0 (socket says 172.21.15.133:59312) 2024-01-19T04:31:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.217+0000 7fa418b12640 1 -- 172.21.15.133:0/2336640795 learned_addr learned my addr 172.21.15.133:0/2336640795 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:57.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.229+0000 7fa4137fe640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415cdb0 0x7fa4140ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:57.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.229+0000 7fa418b12640 1 -- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415cdb0 msgr2=0x7fa4140ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.229+0000 7fa418b12640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415cdb0 0x7fa4140ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.229+0000 7fa418b12640 1 -- 172.21.15.133:0/2336640795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4140c7660 msgr2=0x7fa4140cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.229+0000 7fa418b12640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4140c7660 0x7fa4140cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.229+0000 7fa418b12640 1 -- 172.21.15.133:0/2336640795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc009420 con 0x7fa41415d6d0 2024-01-19T04:31:57.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.333+0000 7fa418b12640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 0x7fa4141f4fb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0097c0 tx=0x7fa3fc0191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.349+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0b6610 con 0x7fa41415d6d0 2024-01-19T04:31:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.349+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc0b6770 con 0x7fa41415d6d0 2024-01-19T04:31:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.349+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0b6b20 con 0x7fa41415d6d0 2024-01-19T04:31:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.349+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4140cba80 con 0x7fa41415d6d0 2024-01-19T04:31:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.349+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41414f930 con 0x7fa41415d6d0 2024-01-19T04:31:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.353+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41414fb50 con 0x7fa41415d6d0 2024-01-19T04:31:57.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.669+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa3fc0b3050 con 0x7fa41415d6d0 2024-01-19T04:31:57.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.673+0000 7fa410ff9640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa3f8066550 0x7fa3f8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:57.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.673+0000 7fa413fff640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa3f8066550 0x7fa3f8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:57.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.673+0000 7fa413fff640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa3f8066550 0x7fa3f8068a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa404004fa0 tx=0x7fa404007ab0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:57.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.681+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3fc0f0030 con 0x7fa41415d6d0 2024-01-19T04:31:57.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.709+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa3fc0ebc70 con 0x7fa41415d6d0 2024-01-19T04:31:57.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.881+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa414074340 con 0x7fa41415d6d0 2024-01-19T04:31:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.941+0000 7fa410ff9640 1 -- 172.21.15.133:0/2336640795 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3fc0a80a0 con 0x7fa41415d6d0 2024-01-19T04:31:57.942 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:31:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa3f8066550 msgr2=0x7fa3f8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa3f8066550 0x7fa3f8068a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa404004fa0 tx=0x7fa404007ab0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 msgr2=0x7fa4141f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 0x7fa4141f4fb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0097c0 tx=0x7fa3fc0191b0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 shutdown_connections 2024-01-19T04:31:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa3f8066550 0x7fa3f8068a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa41415d6d0 0x7fa4141f4fb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa41415cdb0 0x7fa4140ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 --2- 172.21.15.133:0/2336640795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4140c7660 0x7fa4140cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 >> 172.21.15.133:0/2336640795 conn(0x7fa4140cb3e0 msgr2=0x7fa41406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 shutdown_connections 2024-01-19T04:31:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:57.945+0000 7fa41a575640 1 -- 172.21.15.133:0/2336640795 wait complete. 2024-01-19T04:31:57.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:31:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 Processor -- start 2024-01-19T04:31:58.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 -- start start 2024-01-19T04:31:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facbc0c9920 0x7facbc0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0cf9e0 0x7facbc15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc15a170 con 0x7facbc15a600 2024-01-19T04:31:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc159950 con 0x7facbc0c9920 2024-01-19T04:31:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc2267640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0c9420 con 0x7facbc0cf9e0 2024-01-19T04:31:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facc0804640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0cf9e0 0x7facbc15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facbb7fe640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7facbc15a600 0x7facbc0b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:60742/0 (socket says 172.21.15.133:60742) 2024-01-19T04:31:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.093+0000 7facbb7fe640 1 -- 172.21.15.133:0/2147436449 learned_addr learned my addr 172.21.15.133:0/2147436449 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:58.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.101+0000 7facbaffd640 1 -- 172.21.15.133:0/2147436449 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552978787 0 0) 0x7facbc15a170 con 0x7facbc15a600 2024-01-19T04:31:58.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.101+0000 7facbaffd640 1 -- 172.21.15.133:0/2147436449 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca4003530 con 0x7facbc15a600 2024-01-19T04:31:58.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.101+0000 7facc0804640 1 -- 172.21.15.133:0/2147436449 >> v2:172.21.15.133:3300/0 conn(0x7facbc0c9920 msgr2=0x7facbc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:58.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.101+0000 7facc0804640 1 --2- 172.21.15.133:0/2147436449 >> v2:172.21.15.133:3300/0 conn(0x7facbc0c9920 0x7facbc0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.101+0000 7facc0804640 1 -- 172.21.15.133:0/2147436449 >> v1:172.21.15.156:6789/0 conn(0x7facbc15a600 legacy=0x7facbc0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.101+0000 7facc0804640 1 -- 172.21.15.133:0/2147436449 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc15d420 con 0x7facbc0cf9e0 2024-01-19T04:31:58.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.109+0000 7facc0804640 1 --2- 172.21.15.133:0/2147436449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0cf9e0 0x7facbc15cee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7facb4009d90 tx=0x7facb401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c022c923d6fea455 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:58.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facbaffd640 1 -- 172.21.15.133:0/2147436449 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40af600 con 0x7facbc0cf9e0 2024-01-19T04:31:58.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facbaffd640 1 -- 172.21.15.133:0/2147436449 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40ab050 con 0x7facbc0cf9e0 2024-01-19T04:31:58.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facbaffd640 1 -- 172.21.15.133:0/2147436449 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40af980 con 0x7facbc0cf9e0 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 -- 172.21.15.133:0/2147436449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0cf9e0 msgr2=0x7facbc15cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 --2- 172.21.15.133:0/2147436449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0cf9e0 0x7facbc15cee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7facb4009d90 tx=0x7facb401f130 comp rx=0 tx=0).stop 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 -- 172.21.15.133:0/2147436449 shutdown_connections 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 --2- 172.21.15.133:0/2147436449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0cf9e0 0x7facbc15cee0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 --2- 172.21.15.133:0/2147436449 >> v2:172.21.15.133:3300/0 conn(0x7facbc0c9920 0x7facbc0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 -- 172.21.15.133:0/2147436449 >> 172.21.15.133:0/2147436449 conn(0x7facbc08afa0 msgr2=0x7facbc08b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 -- 172.21.15.133:0/2147436449 shutdown_connections 2024-01-19T04:31:58.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 -- 172.21.15.133:0/2147436449 wait complete. 2024-01-19T04:31:58.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 Processor -- start 2024-01-19T04:31:58.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.121+0000 7facc2267640 1 -- start start 2024-01-19T04:31:58.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc2267640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0c9920 0x7facbc15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc2267640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facbc0cf9e0 0x7facbc0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc2267640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 0x7facbc0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc2267640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0c5500 con 0x7facbc15a600 2024-01-19T04:31:58.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc2267640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0c3410 con 0x7facbc0cf9e0 2024-01-19T04:31:58.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc2267640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0c3130 con 0x7facbc0c9920 2024-01-19T04:31:58.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc0804640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 0x7facbc0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc0804640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 0x7facbc0c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56394/0 (socket says 172.21.15.133:56394) 2024-01-19T04:31:58.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facc0804640 1 -- 172.21.15.133:0/1397508888 learned_addr learned my addr 172.21.15.133:0/1397508888 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:58.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facbbfff640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0c9920 0x7facbc15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.125+0000 7facbb7fe640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facbc0cf9e0 0x7facbc0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.129+0000 7facc0804640 1 -- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0c9920 msgr2=0x7facbc15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.129+0000 7facc0804640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0c9920 0x7facbc15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.129+0000 7facc0804640 1 -- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facbc0cf9e0 msgr2=0x7facbc0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.129+0000 7facc0804640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facbc0cf9e0 0x7facbc0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.129+0000 7facc0804640 1 -- 172.21.15.133:0/1397508888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009a70 con 0x7facbc15a600 2024-01-19T04:31:58.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.133+0000 7facc0804640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 0x7facbc0c3b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facb401d7e0 tx=0x7facb401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.137+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40afca0 con 0x7facbc15a600 2024-01-19T04:31:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.137+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40afe00 con 0x7facbc15a600 2024-01-19T04:31:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.137+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40ba640 con 0x7facbc15a600 2024-01-19T04:31:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.137+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc15c170 con 0x7facbc15a600 2024-01-19T04:31:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.137+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc15b660 con 0x7facbc15a600 2024-01-19T04:31:58.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.137+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc06d7f0 con 0x7facbc15a600 2024-01-19T04:31:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.157+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7facb40ba7a0 con 0x7facbc15a600 2024-01-19T04:31:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.161+0000 7facb8ff9640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faca8066550 0x7faca8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.161+0000 7facbbfff640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faca8066550 0x7faca8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.161+0000 7facbbfff640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faca8066550 0x7faca8068a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7facac0098f0 tx=0x7facac006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.161+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facb40f3ae0 con 0x7facbc15a600 2024-01-19T04:31:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.425+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7facb40f38b0 con 0x7facbc15a600 2024-01-19T04:31:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.641+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facbc15b4c0 con 0x7facbc15a600 2024-01-19T04:31:58.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facb8ff9640 1 -- 172.21.15.133:0/1397508888 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7facbc15b4c0 con 0x7facbc15a600 2024-01-19T04:31:58.660 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-19T04:31:58.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faca8066550 msgr2=0x7faca8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faca8066550 0x7faca8068a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7facac0098f0 tx=0x7facac006f90 comp rx=0 tx=0).stop 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 msgr2=0x7facbc0c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 0x7facbc0c3b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facb401d7e0 tx=0x7facb401bed0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 shutdown_connections 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faca8066550 0x7faca8068a10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facbc0cf9e0 0x7facbc0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facbc15a600 0x7facbc0c3b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 --2- 172.21.15.133:0/1397508888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7facbc0c9920 0x7facbc15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 >> 172.21.15.133:0/1397508888 conn(0x7facbc08afa0 msgr2=0x7facbc0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 shutdown_connections 2024-01-19T04:31:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.657+0000 7facc2267640 1 -- 172.21.15.133:0/1397508888 wait complete. 2024-01-19T04:31:58.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-19T04:31:58.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 Processor -- start 2024-01-19T04:31:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 -- start start 2024-01-19T04:31:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30a8153800 0x7f30a81596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a815d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a8159d50 con 0x7f30a806fc50 2024-01-19T04:31:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a8159ff0 con 0x7f30a8153800 2024-01-19T04:31:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30afdf4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a815a2b0 con 0x7f30a80cc3e0 2024-01-19T04:31:58.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30adb90640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30a8153800 0x7f30a81596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30adb90640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30a8153800 0x7f30a81596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56406/0 (socket says 172.21.15.133:56406) 2024-01-19T04:31:58.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.801+0000 7f30adb90640 1 -- 172.21.15.133:0/1979787287 learned_addr learned my addr 172.21.15.133:0/1979787287 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.805+0000 7f30adb90640 1 -- 172.21.15.133:0/1979787287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 msgr2=0x7f30a815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.805+0000 7f30adb90640 1 --2- 172.21.15.133:0/1979787287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.805+0000 7f30adb90640 1 -- 172.21.15.133:0/1979787287 >> v1:172.21.15.156:6789/0 conn(0x7f30a806fc50 legacy=0x7f30a806a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:58.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.805+0000 7f30adb90640 1 -- 172.21.15.133:0/1979787287 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a815cd50 con 0x7f30a8153800 2024-01-19T04:31:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.809+0000 7f30adb90640 1 --2- 172.21.15.133:0/1979787287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 0x7f30a81596c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009870 tx=0x7f30a401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a866cf0c49adb765 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:58.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.821+0000 7f30acb8e640 1 -- 172.21.15.133:0/1979787287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40ab600 con 0x7f30a8153800 2024-01-19T04:31:58.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.821+0000 7f30acb8e640 1 -- 172.21.15.133:0/1979787287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a40a7050 con 0x7f30a8153800 2024-01-19T04:31:58.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.821+0000 7f30acb8e640 1 -- 172.21.15.133:0/1979787287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40ab980 con 0x7f30a8153800 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- 172.21.15.133:0/1979787287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 msgr2=0x7f30a81596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 --2- 172.21.15.133:0/1979787287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 0x7f30a81596c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009870 tx=0x7f30a401c470 comp rx=0 tx=0).stop 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- 172.21.15.133:0/1979787287 shutdown_connections 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 --2- 172.21.15.133:0/1979787287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 --2- 172.21.15.133:0/1979787287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 0x7f30a81596c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- 172.21.15.133:0/1979787287 >> 172.21.15.133:0/1979787287 conn(0x7f30a8072890 msgr2=0x7f30a806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- 172.21.15.133:0/1979787287 shutdown_connections 2024-01-19T04:31:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- 172.21.15.133:0/1979787287 wait complete. 2024-01-19T04:31:58.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 Processor -- start 2024-01-19T04:31:58.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- start start 2024-01-19T04:31:58.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 0x7f30a8155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 0x7f30a814eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:58.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a81f6ed0 con 0x7f30a8153800 2024-01-19T04:31:58.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8155ba0 con 0x7f30a806fc50 2024-01-19T04:31:58.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.825+0000 7f30afdf4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a814e610 con 0x7f30a80cc3e0 2024-01-19T04:31:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.829+0000 7f30adb90640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 0x7f30a8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.829+0000 7f30adb90640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 0x7f30a8155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:59334/0 (socket says 172.21.15.133:59334) 2024-01-19T04:31:58.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.829+0000 7f30adb90640 1 -- 172.21.15.133:0/4213577346 learned_addr learned my addr 172.21.15.133:0/4213577346 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:58.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.833+0000 7f30ad38f640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:58.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.837+0000 7f30adb90640 1 -- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 msgr2=0x7f30a8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.837+0000 7f30adb90640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.837+0000 7f30adb90640 1 -- 172.21.15.133:0/4213577346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 msgr2=0x7f30a814eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:58.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.837+0000 7f30adb90640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 0x7f30a814eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:58.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.837+0000 7f30adb90640 1 -- 172.21.15.133:0/4213577346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40094d0 con 0x7f30a806fc50 2024-01-19T04:31:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.849+0000 7f30adb90640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 0x7f30a8155660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30a40ae040 tx=0x7f30a401acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:58.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.861+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40b6620 con 0x7f30a806fc50 2024-01-19T04:31:58.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.861+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a40b67a0 con 0x7f30a806fc50 2024-01-19T04:31:58.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.861+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40b6b50 con 0x7f30a806fc50 2024-01-19T04:31:58.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.861+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a81f6c30 con 0x7f30a806fc50 2024-01-19T04:31:58.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.861+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a814dd60 con 0x7f30a806fc50 2024-01-19T04:31:58.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:58.861+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a8074340 con 0x7f30a806fc50 2024-01-19T04:31:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.237+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f30a40b2040 con 0x7f30a806fc50 2024-01-19T04:31:59.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.241+0000 7f309e7fc640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f308c066530 0x7f308c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.241+0000 7f30ad38f640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f308c066530 0x7f308c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:59.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.241+0000 7f30ad38f640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f308c066530 0x7f308c0689f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30a80c9f80 tx=0x7f3098009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.245+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30a40ef840 con 0x7f30a806fc50 2024-01-19T04:31:59.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.277+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f30a40ebb80 con 0x7f30a806fc50 2024-01-19T04:31:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.437+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f30a8164e30 con 0x7f30a806fc50 2024-01-19T04:31:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f309e7fc640 1 -- 172.21.15.133:0/4213577346 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f30a40c40a0 con 0x7f30a806fc50 2024-01-19T04:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:31:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f308c066530 msgr2=0x7f308c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f308c066530 0x7f308c0689f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30a80c9f80 tx=0x7f3098009110 comp rx=0 tx=0).stop 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 msgr2=0x7f30a8155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 0x7f30a8155660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30a40ae040 tx=0x7f30a401acb0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 shutdown_connections 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f308c066530 0x7f308c0689f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8153800 0x7f30a814eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a80cc3e0 0x7f30a8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 --2- 172.21.15.133:0/4213577346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a806fc50 0x7f30a8155660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 >> 172.21.15.133:0/4213577346 conn(0x7f30a8072890 msgr2=0x7f30a80ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 shutdown_connections 2024-01-19T04:31:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.461+0000 7f30afdf4640 1 -- 172.21.15.133:0/4213577346 wait complete. 2024-01-19T04:31:59.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:31:59.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 Processor -- start 2024-01-19T04:31:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 -- start start 2024-01-19T04:31:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff284151590 0x7ff284071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff28406de70 0x7ff28406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28406e750 con 0x7ff28406da50 2024-01-19T04:31:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2841573c0 con 0x7ff28406de70 2024-01-19T04:31:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.601+0000 7ff289b8b640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2841575b0 con 0x7ff284151590 2024-01-19T04:31:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.605+0000 7ff283fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff28406de70 0x7ff28406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.605+0000 7ff282ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff28406da50 0x7ff2840c7d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38830/0 (socket says 172.21.15.133:38830) 2024-01-19T04:31:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.605+0000 7ff282ffd640 1 -- 172.21.15.133:0/2171392567 learned_addr learned my addr 172.21.15.133:0/2171392567 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:31:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.605+0000 7ff2837fe640 1 --2- 172.21.15.133:0/2171392567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff284151590 0x7ff284071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.609+0000 7ff283fff640 1 -- 172.21.15.133:0/2171392567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff284151590 msgr2=0x7ff284071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:31:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.609+0000 7ff283fff640 1 --2- 172.21.15.133:0/2171392567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff284151590 0x7ff284071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.609+0000 7ff283fff640 1 -- 172.21.15.133:0/2171392567 >> v1:172.21.15.133:6789/0 conn(0x7ff28406da50 legacy=0x7ff2840c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.609+0000 7ff283fff640 1 -- 172.21.15.133:0/2171392567 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff284157870 con 0x7ff28406de70 2024-01-19T04:31:59.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.613+0000 7ff283fff640 1 --2- 172.21.15.133:0/2171392567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 0x7ff28406ebe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2740097c0 tx=0x7ff27401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21affe74cc4334d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff2827fc640 1 -- 172.21.15.133:0/2171392567 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740ab650 con 0x7ff28406de70 2024-01-19T04:31:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff2827fc640 1 -- 172.21.15.133:0/2171392567 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2740ab7b0 con 0x7ff28406de70 2024-01-19T04:31:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff2827fc640 1 -- 172.21.15.133:0/2171392567 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740abb40 con 0x7ff28406de70 2024-01-19T04:31:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 -- 172.21.15.133:0/2171392567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 msgr2=0x7ff28406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 --2- 172.21.15.133:0/2171392567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 0x7ff28406ebe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2740097c0 tx=0x7ff27401c450 comp rx=0 tx=0).stop 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 -- 172.21.15.133:0/2171392567 shutdown_connections 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 --2- 172.21.15.133:0/2171392567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 0x7ff28406ebe0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 --2- 172.21.15.133:0/2171392567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff284151590 0x7ff284071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 -- 172.21.15.133:0/2171392567 >> 172.21.15.133:0/2171392567 conn(0x7ff28406aa60 msgr2=0x7ff28406ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 -- 172.21.15.133:0/2171392567 shutdown_connections 2024-01-19T04:31:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.621+0000 7ff289b8b640 1 -- 172.21.15.133:0/2171392567 wait complete. 2024-01-19T04:31:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 Processor -- start 2024-01-19T04:31:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 -- start start 2024-01-19T04:31:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 0x7ff2840cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 0x7ff2840c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff284151590 0x7ff2840bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:31:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840c1bd0 con 0x7ff28406de70 2024-01-19T04:31:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840c4940 con 0x7ff284151590 2024-01-19T04:31:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff289b8b640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840cbc50 con 0x7ff28406da50 2024-01-19T04:31:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff2837fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 0x7ff2840cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.625+0000 7ff283fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff284151590 0x7ff2840bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:31:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.629+0000 7ff2837fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 0x7ff2840cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:50196/0 (socket says 172.21.15.133:50196) 2024-01-19T04:31:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.629+0000 7ff2837fe640 1 -- 172.21.15.133:0/1430875531 learned_addr learned my addr 172.21.15.133:0/1430875531 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:31:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.637+0000 7ff2837fe640 1 -- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff284151590 msgr2=0x7ff2840bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.637+0000 7ff2837fe640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff284151590 0x7ff2840bfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.637+0000 7ff2837fe640 1 -- 172.21.15.133:0/1430875531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 msgr2=0x7ff2840c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:31:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.637+0000 7ff2837fe640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 0x7ff2840c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:31:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.637+0000 7ff2837fe640 1 -- 172.21.15.133:0/1430875531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009420 con 0x7ff28406da50 2024-01-19T04:31:59.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.645+0000 7ff2837fe640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 0x7ff2840cb710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00efc0 tx=0x7ff27c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:31:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.657+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c009b80 con 0x7ff28406da50 2024-01-19T04:31:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.657+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c00f040 con 0x7ff28406da50 2024-01-19T04:31:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.657+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff284160410 con 0x7ff28406da50 2024-01-19T04:31:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.657+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0146a0 con 0x7ff28406da50 2024-01-19T04:31:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.657+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2840c3b80 con 0x7ff28406da50 2024-01-19T04:31:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:31:59.657+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284074340 con 0x7ff28406da50 2024-01-19T04:32:00.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.009+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff27c014800 con 0x7ff28406da50 2024-01-19T04:32:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.009+0000 7ff27bfff640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff264066550 0x7ff264068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.009+0000 7ff282ffd640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff264066550 0x7ff264068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.009+0000 7ff282ffd640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff264066550 0x7ff264068a10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f70 tx=0x7ff26c007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.013+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff27c056760 con 0x7ff28406da50 2024-01-19T04:32:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.041+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff27c0523a0 con 0x7ff28406da50 2024-01-19T04:32:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.221+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff284150a30 con 0x7ff28406da50 2024-01-19T04:32:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.525+0000 7ff27bfff640 1 -- 172.21.15.133:0/1430875531 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff27c0559c0 con 0x7ff28406da50 2024-01-19T04:32:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-01-19T04:32:00.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff264066550 msgr2=0x7ff264068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:00.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff264066550 0x7ff264068a10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f70 tx=0x7ff26c007a90 comp rx=0 tx=0).stop 2024-01-19T04:32:00.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 msgr2=0x7ff2840cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:00.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 0x7ff2840cb710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00efc0 tx=0x7ff27c00c490 comp rx=0 tx=0).stop 2024-01-19T04:32:00.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 shutdown_connections 2024-01-19T04:32:00.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff264066550 0x7ff264068a10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff284151590 0x7ff2840bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff28406de70 0x7ff2840c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 --2- 172.21.15.133:0/1430875531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff28406da50 0x7ff2840cb710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 >> 172.21.15.133:0/1430875531 conn(0x7ff28406aa60 msgr2=0x7ff2840c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 shutdown_connections 2024-01-19T04:32:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:00.529+0000 7ff289b8b640 1 -- 172.21.15.133:0/1430875531 wait complete. 2024-01-19T04:32:00.556 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2024-01-19T04:32:00.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:00.556 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-19T04:32:00.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:ceph-fuse[33294]: fuse finished with error 0 and tester_r 0 2024-01-19T04:32:00.677 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:32:06.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T04:32:06.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:06.779 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-19T04:32:06.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.009+0000 7f3758836640 1 Processor -- start 2024-01-19T04:32:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.009+0000 7f3758836640 1 -- start start 2024-01-19T04:32:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3758836640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3754151600 0x7f375415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3758836640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37541519e0 0x7f37540c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3758836640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3754158390 con 0x7f375406f350 2024-01-19T04:32:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3758836640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375415b0e0 con 0x7f3754151600 2024-01-19T04:32:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3758836640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754157b70 con 0x7f37541519e0 2024-01-19T04:32:07.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f375259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3754151600 0x7f375415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3752d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f375406f350 0x7f3754157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47460/0 (socket says 172.21.15.133:47460) 2024-01-19T04:32:07.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3752d9d640 1 -- 172.21.15.133:0/1451117195 learned_addr learned my addr 172.21.15.133:0/1451117195 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:07.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.013+0000 7f3751d9b640 1 --2- 172.21.15.133:0/1451117195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37541519e0 0x7f37540c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.017+0000 7f375259c640 1 -- 172.21.15.133:0/1451117195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37541519e0 msgr2=0x7f37540c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:07.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.017+0000 7f375259c640 1 --2- 172.21.15.133:0/1451117195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37541519e0 0x7f37540c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.017+0000 7f375259c640 1 -- 172.21.15.133:0/1451117195 >> v1:172.21.15.133:6789/0 conn(0x7f375406f350 legacy=0x7f3754157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.017+0000 7f375259c640 1 -- 172.21.15.133:0/1451117195 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754157dd0 con 0x7f3754151600 2024-01-19T04:32:07.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.029+0000 7f375259c640 1 --2- 172.21.15.133:0/1451117195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3754151600 0x7f375415b570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f374c0097c0 tx=0x7f374c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e618327964d64021 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f375159a640 1 -- 172.21.15.133:0/1451117195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0ab600 con 0x7f3754151600 2024-01-19T04:32:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f375159a640 1 -- 172.21.15.133:0/1451117195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0a7050 con 0x7f3754151600 2024-01-19T04:32:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f375159a640 1 -- 172.21.15.133:0/1451117195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0ab980 con 0x7f3754151600 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 -- 172.21.15.133:0/1451117195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3754151600 msgr2=0x7f375415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 --2- 172.21.15.133:0/1451117195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3754151600 0x7f375415b570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f374c0097c0 tx=0x7f374c01c480 comp rx=0 tx=0).stop 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 -- 172.21.15.133:0/1451117195 shutdown_connections 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 --2- 172.21.15.133:0/1451117195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37541519e0 0x7f37540c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 --2- 172.21.15.133:0/1451117195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3754151600 0x7f375415b570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 -- 172.21.15.133:0/1451117195 >> 172.21.15.133:0/1451117195 conn(0x7f375406d590 msgr2=0x7f3754066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 -- 172.21.15.133:0/1451117195 shutdown_connections 2024-01-19T04:32:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.041+0000 7f3758836640 1 -- 172.21.15.133:0/1451117195 wait complete. 2024-01-19T04:32:07.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 Processor -- start 2024-01-19T04:32:07.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 -- start start 2024-01-19T04:32:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 0x7f37541446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3754151600 0x7f3754146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3754145400 0x7f3754140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754143ae0 con 0x7f375406f350 2024-01-19T04:32:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540c8f60 con 0x7f3754145400 2024-01-19T04:32:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3758836640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540c9240 con 0x7f3754151600 2024-01-19T04:32:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f375259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 0x7f37541446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f375259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 0x7f37541446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48628/0 (socket says 172.21.15.133:48628) 2024-01-19T04:32:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f375259c640 1 -- 172.21.15.133:0/198112572 learned_addr learned my addr 172.21.15.133:0/198112572 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3751d9b640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3754151600 0x7f3754146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.045+0000 7f3752d9d640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3754145400 0x7f3754140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.049+0000 7f375259c640 1 -- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3754151600 msgr2=0x7f3754146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.049+0000 7f375259c640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3754151600 0x7f3754146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.049+0000 7f375259c640 1 -- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3754145400 msgr2=0x7f3754140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.049+0000 7f375259c640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3754145400 0x7f3754140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.049+0000 7f375259c640 1 -- 172.21.15.133:0/198112572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009420 con 0x7f375406f350 2024-01-19T04:32:07.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.053+0000 7f375259c640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 0x7f37541446d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f374c019090 tx=0x7f374c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:07.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.057+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0b4600 con 0x7f375406f350 2024-01-19T04:32:07.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.057+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0b4760 con 0x7f375406f350 2024-01-19T04:32:07.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.057+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0b4b10 con 0x7f375406f350 2024-01-19T04:32:07.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.057+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37540c9520 con 0x7f375406f350 2024-01-19T04:32:07.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.057+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540c9800 con 0x7f375406f350 2024-01-19T04:32:07.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.057+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37540c9380 con 0x7f375406f350 2024-01-19T04:32:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.309+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f374c0b2040 con 0x7f375406f350 2024-01-19T04:32:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.309+0000 7f374affd640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3734066550 0x7f3734068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.309+0000 7f3751d9b640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3734066550 0x7f3734068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.309+0000 7f3751d9b640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3734066550 0x7f3734068a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3754161c50 tx=0x7f373c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:07.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.329+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f374c0abe40 con 0x7f375406f350 2024-01-19T04:32:07.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.329+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f374c0eb7e0 con 0x7f375406f350 2024-01-19T04:32:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.497+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3754140320 con 0x7f375406f350 2024-01-19T04:32:07.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.585+0000 7f374affd640 1 -- 172.21.15.133:0/198112572 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f3754140320 con 0x7f375406f350 2024-01-19T04:32:07.588 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:07.588 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:07.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3734066550 msgr2=0x7f3734068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3734066550 0x7f3734068a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3754161c50 tx=0x7f373c009190 comp rx=0 tx=0).stop 2024-01-19T04:32:07.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 msgr2=0x7f37541446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 0x7f37541446d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f374c019090 tx=0x7f374c019220 comp rx=0 tx=0).stop 2024-01-19T04:32:07.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 shutdown_connections 2024-01-19T04:32:07.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3734066550 0x7f3734068a10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3754145400 0x7f3754140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3754151600 0x7f3754146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 --2- 172.21.15.133:0/198112572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f375406f350 0x7f37541446d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 >> 172.21.15.133:0/198112572 conn(0x7f375406d590 msgr2=0x7f375414d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 shutdown_connections 2024-01-19T04:32:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.589+0000 7f3758836640 1 -- 172.21.15.133:0/198112572 wait complete. 2024-01-19T04:32:07.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 Processor -- start 2024-01-19T04:32:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 -- start start 2024-01-19T04:32:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e4151600 0x7fd1e415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1e41519e0 0x7fd1e40c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e4158390 con 0x7fd1e406f350 2024-01-19T04:32:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e415b0e0 con 0x7fd1e41519e0 2024-01-19T04:32:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1eb55a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e4157b70 con 0x7fd1e4151600 2024-01-19T04:32:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.737+0000 7fd1e8af5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1e41519e0 0x7fd1e40c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e8af5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1e41519e0 0x7fd1e40c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48632/0 (socket says 172.21.15.133:48632) 2024-01-19T04:32:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e8af5640 1 -- 172.21.15.133:0/1464944613 learned_addr learned my addr 172.21.15.133:0/1464944613 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e92f6640 1 --2- 172.21.15.133:0/1464944613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e4151600 0x7fd1e415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e8af5640 1 -- 172.21.15.133:0/1464944613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e4151600 msgr2=0x7fd1e415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:07.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e8af5640 1 --2- 172.21.15.133:0/1464944613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e4151600 0x7fd1e415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e8af5640 1 -- 172.21.15.133:0/1464944613 >> v1:172.21.15.156:6789/0 conn(0x7fd1e406f350 legacy=0x7fd1e4157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.741+0000 7fd1e8af5640 1 -- 172.21.15.133:0/1464944613 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e4157dd0 con 0x7fd1e41519e0 2024-01-19T04:32:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.745+0000 7fd1e8af5640 1 --2- 172.21.15.133:0/1464944613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e41519e0 0x7fd1e40c7660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009e50 tx=0x7fd1d801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56ee1b2cfa4bc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:07.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.749+0000 7fd1e3fff640 1 -- 172.21.15.133:0/1464944613 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80a57d0 con 0x7fd1e41519e0 2024-01-19T04:32:07.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.749+0000 7fd1e3fff640 1 -- 172.21.15.133:0/1464944613 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d80a5930 con 0x7fd1e41519e0 2024-01-19T04:32:07.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.749+0000 7fd1e3fff640 1 -- 172.21.15.133:0/1464944613 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80a5cc0 con 0x7fd1e41519e0 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- 172.21.15.133:0/1464944613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e41519e0 msgr2=0x7fd1e40c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/1464944613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e41519e0 0x7fd1e40c7660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009e50 tx=0x7fd1d801ca10 comp rx=0 tx=0).stop 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- 172.21.15.133:0/1464944613 shutdown_connections 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/1464944613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e41519e0 0x7fd1e40c7660 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/1464944613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e4151600 0x7fd1e415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- 172.21.15.133:0/1464944613 >> 172.21.15.133:0/1464944613 conn(0x7fd1e406d590 msgr2=0x7fd1e4066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- 172.21.15.133:0/1464944613 shutdown_connections 2024-01-19T04:32:07.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- 172.21.15.133:0/1464944613 wait complete. 2024-01-19T04:32:07.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 Processor -- start 2024-01-19T04:32:07.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- start start 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e406f350 0x7fd1e40c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 0x7fd1e41f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e4144c20 0x7fd1e4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41f5690 con 0x7fd1e4151600 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e4144920 con 0x7fd1e4144c20 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1eb55a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41451a0 con 0x7fd1e406f350 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1e8af5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 0x7fd1e41f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1e8af5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 0x7fd1e41f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48640/0 (socket says 172.21.15.133:48640) 2024-01-19T04:32:07.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1e8af5640 1 -- 172.21.15.133:0/3753135795 learned_addr learned my addr 172.21.15.133:0/3753135795 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:07.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1e9af7640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e4144c20 0x7fd1e4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.753+0000 7fd1e92f6640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e406f350 0x7fd1e40c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:07.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.757+0000 7fd1e8af5640 1 -- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e406f350 msgr2=0x7fd1e40c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.757+0000 7fd1e8af5640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e406f350 0x7fd1e40c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.757+0000 7fd1e8af5640 1 -- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e4144c20 msgr2=0x7fd1e4071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:07.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.757+0000 7fd1e8af5640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e4144c20 0x7fd1e4071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:07.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.757+0000 7fd1e8af5640 1 -- 172.21.15.133:0/3753135795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009b30 con 0x7fd1e4151600 2024-01-19T04:32:07.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.761+0000 7fd1e8af5640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 0x7fd1e41f5b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd1d801b0c0 tx=0x7fd1d80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:07.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.765+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80b8670 con 0x7fd1e4151600 2024-01-19T04:32:07.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.765+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d80b8810 con 0x7fd1e4151600 2024-01-19T04:32:07.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.765+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80b8bc0 con 0x7fd1e4151600 2024-01-19T04:32:07.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.765+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e4145480 con 0x7fd1e4151600 2024-01-19T04:32:07.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.765+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e41f5040 con 0x7fd1e4151600 2024-01-19T04:32:07.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:07.765+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e41f5800 con 0x7fd1e4151600 2024-01-19T04:32:07.999 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:32:08.002 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:32:08.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.033+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd1d80b8d20 con 0x7fd1e4151600 2024-01-19T04:32:08.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.033+0000 7fd1e1ffb640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd1d0066580 0x7fd1d0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.033+0000 7fd1e92f6640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd1d0066580 0x7fd1d0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.033+0000 7fd1e92f6640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd1d0066580 0x7fd1d0068a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009ac0 tx=0x7fd1dc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:08.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.053+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1d80f0e30 con 0x7fd1e4151600 2024-01-19T04:32:08.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.053+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd1d80ed170 con 0x7fd1e4151600 2024-01-19T04:32:08.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.249+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1e4071fa0 con 0x7fd1e4151600 2024-01-19T04:32:08.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.337+0000 7fd1e1ffb640 1 -- 172.21.15.133:0/3753135795 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7fd1d80f0790 con 0x7fd1e4151600 2024-01-19T04:32:08.338 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:08.338 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd1d0066580 msgr2=0x7fd1d0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd1d0066580 0x7fd1d0068a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009ac0 tx=0x7fd1dc009190 comp rx=0 tx=0).stop 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 msgr2=0x7fd1e41f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 0x7fd1e41f5b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd1d801b0c0 tx=0x7fd1d80197b0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 shutdown_connections 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd1d0066580 0x7fd1d0068a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e4144c20 0x7fd1e4071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1e4151600 0x7fd1e41f5b20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 --2- 172.21.15.133:0/3753135795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e406f350 0x7fd1e40c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 >> 172.21.15.133:0/3753135795 conn(0x7fd1e406d590 msgr2=0x7fd1e414bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:08.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 shutdown_connections 2024-01-19T04:32:08.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.341+0000 7fd1eb55a640 1 -- 172.21.15.133:0/3753135795 wait complete. 2024-01-19T04:32:08.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T04:32:08.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.545+0000 7f25b6e39640 1 Processor -- start 2024-01-19T04:32:08.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.545+0000 7f25b6e39640 1 -- start start 2024-01-19T04:32:08.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.549+0000 7f25b6e39640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25b00c7cd0 0x7f25b00c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.549+0000 7f25b6e39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b00c5c40 con 0x7f25b01503c0 2024-01-19T04:32:08.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.549+0000 7f25b6e39640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b0156760 con 0x7f25b00c57d0 2024-01-19T04:32:08.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.549+0000 7f25b6e39640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b0157300 con 0x7f25b00c7cd0 2024-01-19T04:32:08.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.549+0000 7f25b4bd5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f25b01503c0 0x7f25b0072760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47476/0 (socket says 172.21.15.133:47476) 2024-01-19T04:32:08.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.549+0000 7f25b4bd5640 1 -- 172.21.15.133:0/1610330923 learned_addr learned my addr 172.21.15.133:0/1610330923 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.553+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716492848 0 0) 0x7f25b00c5c40 con 0x7f25b01503c0 2024-01-19T04:32:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.553+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a0003530 con 0x7f25b01503c0 2024-01-19T04:32:08.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152265030 0 0) 0x7f25a0003530 con 0x7f25b01503c0 2024-01-19T04:32:08.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 >> v2:172.21.15.156:3300/0 conn(0x7f25b00c7cd0 msgr2=0x7f25b00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 --2- 172.21.15.133:0/1610330923 >> v2:172.21.15.156:3300/0 conn(0x7f25b00c7cd0 0x7f25b00c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 >> v1:172.21.15.156:6789/0 conn(0x7f25b00c57d0 legacy=0x7f25b0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b01507a0 con 0x7f25b01503c0 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f25a4001680 con 0x7f25b01503c0 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 >> v1:172.21.15.133:6789/0 conn(0x7f25b01503c0 legacy=0x7f25b0072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0003a40 0x7f25a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a00047d0 0x7f25a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0005390 0x7f25a000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b0157300 con 0x7f25a0005390 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a000e450 con 0x7f25a0003a40 2024-01-19T04:32:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a000e610 con 0x7f25a00047d0 2024-01-19T04:32:08.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.557+0000 7f25b53d6640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0005390 0x7f25a000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.561+0000 7f25affff640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a00047d0 0x7f25a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.561+0000 7f25b53d6640 1 -- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a00047d0 msgr2=0x7f25a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:08.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.561+0000 7f25b53d6640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a00047d0 0x7f25a0004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.561+0000 7f25b53d6640 1 -- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0003a40 msgr2=0x7f25a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:08.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.561+0000 7f25b53d6640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0003a40 0x7f25a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.561+0000 7f25b53d6640 1 -- 172.21.15.133:0/1610330923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0003530 con 0x7f25a0005390 2024-01-19T04:32:08.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.565+0000 7f25b53d6640 1 -- 172.21.15.133:0/1610330923 reap_dead start 2024-01-19T04:32:08.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.573+0000 7f25b53d6640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0005390 0x7f25a000dba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009ca0 tx=0x7f25a801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5408860ea7ac2b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80a5c60 con 0x7f25a0005390 2024-01-19T04:32:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80a5e00 con 0x7f25a0005390 2024-01-19T04:32:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25af7fe640 1 -- 172.21.15.133:0/1610330923 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8003bc0 con 0x7f25a0005390 2024-01-19T04:32:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 -- 172.21.15.133:0/1610330923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0005390 msgr2=0x7f25a000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0005390 0x7f25a000dba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009ca0 tx=0x7f25a801cc50 comp rx=0 tx=0).stop 2024-01-19T04:32:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 -- 172.21.15.133:0/1610330923 shutdown_connections 2024-01-19T04:32:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 --2- 172.21.15.133:0/1610330923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0005390 0x7f25a000dba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 -- 172.21.15.133:0/1610330923 >> 172.21.15.133:0/1610330923 conn(0x7f25b006aa60 msgr2=0x7f25b006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 -- 172.21.15.133:0/1610330923 shutdown_connections 2024-01-19T04:32:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.577+0000 7f25b6e39640 1 -- 172.21.15.133:0/1610330923 wait complete. 2024-01-19T04:32:08.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 Processor -- start 2024-01-19T04:32:08.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 -- start start 2024-01-19T04:32:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0005390 0x7f25b014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b0149fd0 0x7f25b00ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b014a670 0x7f25b014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b014cb30 con 0x7f25b0149fd0 2024-01-19T04:32:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b014bf50 con 0x7f25a0005390 2024-01-19T04:32:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b6e39640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b015a690 con 0x7f25b014a670 2024-01-19T04:32:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.581+0000 7f25b53d6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b014a670 0x7f25b014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.585+0000 7f25affff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b0149fd0 0x7f25b00ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.585+0000 7f25b4bd5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0005390 0x7f25b014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.585+0000 7f25b53d6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b014a670 0x7f25b014aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43026/0 (socket says 172.21.15.133:43026) 2024-01-19T04:32:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.585+0000 7f25b53d6640 1 -- 172.21.15.133:0/2081975025 learned_addr learned my addr 172.21.15.133:0/2081975025 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:08.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.597+0000 7f25b4bd5640 1 -- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b014a670 msgr2=0x7f25b014aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:08.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.597+0000 7f25b4bd5640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b014a670 0x7f25b014aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.597+0000 7f25b4bd5640 1 -- 172.21.15.133:0/2081975025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b0149fd0 msgr2=0x7f25b00ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:08.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.597+0000 7f25b4bd5640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b0149fd0 0x7f25b00ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:08.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.597+0000 7f25b4bd5640 1 -- 172.21.15.133:0/2081975025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b014bcb0 con 0x7f25a0005390 2024-01-19T04:32:08.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.609+0000 7f25b4bd5640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0005390 0x7f25b014e3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c730 tx=0x7f25a400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:08.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.625+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40072d0 con 0x7f25a0005390 2024-01-19T04:32:08.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.625+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4007430 con 0x7f25a0005390 2024-01-19T04:32:08.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.625+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40047f0 con 0x7f25a0005390 2024-01-19T04:32:08.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.625+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b014c570 con 0x7f25a0005390 2024-01-19T04:32:08.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.625+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b014dea0 con 0x7f25a0005390 2024-01-19T04:32:08.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.625+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b014e0c0 con 0x7f25a0005390 2024-01-19T04:32:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.953+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f25a400a640 con 0x7f25a0005390 2024-01-19T04:32:08.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.953+0000 7f25ad7fa640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2594066580 0x7f2594068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:08.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.953+0000 7f25affff640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2594066580 0x7f2594068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:08.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.953+0000 7f25affff640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2594066580 0x7f2594068a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f259c007fd0 tx=0x7f259c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:08.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:08.961+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25a40549c0 con 0x7f25a0005390 2024-01-19T04:32:09.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:09.001+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f25a4050d00 con 0x7f25a0005390 2024-01-19T04:32:09.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:09.221+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f25b0074340 con 0x7f25a0005390 2024-01-19T04:32:10.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2081975025 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v9) v1 ==== 118+0+0 (secure 0 0 0) 0x7f25a40180b0 con 0x7f25a0005390 2024-01-19T04:32:10.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2594066580 msgr2=0x7f2594068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:10.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2594066580 0x7f2594068a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f259c007fd0 tx=0x7f259c009040 comp rx=0 tx=0).stop 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0005390 msgr2=0x7f25b014e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0005390 0x7f25b014e3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c730 tx=0x7f25a400cbf0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 shutdown_connections 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2594066580 0x7f2594068a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b014a670 0x7f25b014aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b0149fd0 0x7f25b00ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 --2- 172.21.15.133:0/2081975025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0005390 0x7f25b014e3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 >> 172.21.15.133:0/2081975025 conn(0x7f25b006aa60 msgr2=0x7f25b006ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 shutdown_connections 2024-01-19T04:32:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.557+0000 7f25b6e39640 1 -- 172.21.15.133:0/2081975025 wait complete. 2024-01-19T04:32:10.581 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-01-19T04:32:10.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-01-19T04:32:10.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.705+0000 7f46834c0640 1 Processor -- start 2024-01-19T04:32:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.705+0000 7f46834c0640 1 -- start start 2024-01-19T04:32:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f46834c0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f467c0c8310 0x7f467c151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f46834c0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c15a9d0 con 0x7f467c0c7f30 2024-01-19T04:32:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f46834c0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c1573e0 con 0x7f467c071970 2024-01-19T04:32:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f46834c0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c06e1a0 con 0x7f467c0c8310 2024-01-19T04:32:10.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f468125c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f467c0c7f30 0x7f467c06da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47482/0 (socket says 172.21.15.133:47482) 2024-01-19T04:32:10.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f468125c640 1 -- 172.21.15.133:0/3146981160 learned_addr learned my addr 172.21.15.133:0/3146981160 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:10.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.709+0000 7f4680a5b640 1 --2- 172.21.15.133:0/3146981160 >> v2:172.21.15.156:3300/0 conn(0x7f467c0c8310 0x7f467c151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:10.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.713+0000 7f4673fff640 1 -- 172.21.15.133:0/3146981160 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713456637 0 0) 0x7f467c15a9d0 con 0x7f467c0c7f30 2024-01-19T04:32:10.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.713+0000 7f4673fff640 1 -- 172.21.15.133:0/3146981160 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4668003530 con 0x7f467c0c7f30 2024-01-19T04:32:10.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.717+0000 7f4673fff640 1 -- 172.21.15.133:0/3146981160 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3247353193 0 0) 0x7f4668003530 con 0x7f467c0c7f30 2024-01-19T04:32:10.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.717+0000 7f4680a5b640 1 -- 172.21.15.133:0/3146981160 >> v1:172.21.15.156:6789/0 conn(0x7f467c071970 legacy=0x7f467c15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:10.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.717+0000 7f4680a5b640 1 -- 172.21.15.133:0/3146981160 >> v1:172.21.15.133:6789/0 conn(0x7f467c0c7f30 legacy=0x7f467c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:10.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.717+0000 7f4680a5b640 1 -- 172.21.15.133:0/3146981160 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c1576a0 con 0x7f467c0c8310 2024-01-19T04:32:10.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.725+0000 7f4680a5b640 1 --2- 172.21.15.133:0/3146981160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c0c8310 0x7f467c151190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097c0 tx=0x7f466c01eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c08d46d8741a586f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:10.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f4673fff640 1 -- 172.21.15.133:0/3146981160 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678001680 con 0x7f467c0c8310 2024-01-19T04:32:10.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f4673fff640 1 -- 172.21.15.133:0/3146981160 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c0a8610 con 0x7f467c0c8310 2024-01-19T04:32:10.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f4673fff640 1 -- 172.21.15.133:0/3146981160 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0a89a0 con 0x7f467c0c8310 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 -- 172.21.15.133:0/3146981160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c0c8310 msgr2=0x7f467c151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 --2- 172.21.15.133:0/3146981160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c0c8310 0x7f467c151190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097c0 tx=0x7f466c01eb50 comp rx=0 tx=0).stop 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 -- 172.21.15.133:0/3146981160 shutdown_connections 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 --2- 172.21.15.133:0/3146981160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c0c8310 0x7f467c151190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 -- 172.21.15.133:0/3146981160 >> 172.21.15.133:0/3146981160 conn(0x7f467c06aa60 msgr2=0x7f467c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 -- 172.21.15.133:0/3146981160 shutdown_connections 2024-01-19T04:32:10.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.737+0000 7f46834c0640 1 -- 172.21.15.133:0/3146981160 wait complete. 2024-01-19T04:32:10.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 Processor -- start 2024-01-19T04:32:10.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 -- start start 2024-01-19T04:32:10.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c071970 0x7f467c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:10.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f467c0c7f30 0x7f467c1f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:10.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 0x7f467c0c0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:10.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c1f3be0 con 0x7f467c0c8310 2024-01-19T04:32:10.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c15a5b0 con 0x7f467c071970 2024-01-19T04:32:10.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f46834c0640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c3c70 con 0x7f467c0c7f30 2024-01-19T04:32:10.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f4681a5d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 0x7f467c0c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:10.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f4681a5d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 0x7f467c0c0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48658/0 (socket says 172.21.15.133:48658) 2024-01-19T04:32:10.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f4681a5d640 1 -- 172.21.15.133:0/20228400 learned_addr learned my addr 172.21.15.133:0/20228400 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:10.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.741+0000 7f4680a5b640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f467c0c7f30 0x7f467c1f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:10.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.749+0000 7f4681a5d640 1 -- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f467c0c7f30 msgr2=0x7f467c1f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:10.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.749+0000 7f4681a5d640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f467c0c7f30 0x7f467c1f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.749+0000 7f4681a5d640 1 -- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c071970 msgr2=0x7f467c15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.749+0000 7f4681a5d640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c071970 0x7f467c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.749+0000 7f4681a5d640 1 -- 172.21.15.133:0/20228400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009420 con 0x7f467c0c8310 2024-01-19T04:32:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.753+0000 7f4681a5d640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 0x7f467c0c0920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f467400c7b0 tx=0x7f467400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.761+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674003d90 con 0x7f467c0c8310 2024-01-19T04:32:10.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.761+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467400ce60 con 0x7f467c0c8310 2024-01-19T04:32:10.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.761+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740052b0 con 0x7f467c0c8310 2024-01-19T04:32:10.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.761+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c15a970 con 0x7f467c0c8310 2024-01-19T04:32:10.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.761+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c0c3f20 con 0x7f467c0c8310 2024-01-19T04:32:10.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:10.761+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c074340 con 0x7f467c0c8310 2024-01-19T04:32:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.045+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4674005410 con 0x7f467c0c8310 2024-01-19T04:32:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.045+0000 7f4671ffb640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4660066550 0x7f4660068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.045+0000 7f468125c640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4660066550 0x7f4660068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:11.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.045+0000 7f468125c640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4660066550 0x7f4660068a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4678001e90 tx=0x7f46780010b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:11.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.081+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4674054ad0 con 0x7f467c0c8310 2024-01-19T04:32:11.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.081+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4674050e10 con 0x7f467c0c8310 2024-01-19T04:32:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.285+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f467c150c20 con 0x7f467c0c8310 2024-01-19T04:32:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.617+0000 7f4671ffb640 1 -- 172.21.15.133:0/20228400 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v10) v1 ==== 105+0+0 (secure 0 0 0) 0x7f46740170b0 con 0x7f467c0c8310 2024-01-19T04:32:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4660066550 msgr2=0x7f4660068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4660066550 0x7f4660068a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4678001e90 tx=0x7f46780010b0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 msgr2=0x7f467c0c0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 0x7f467c0c0920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f467400c7b0 tx=0x7f467400cc70 comp rx=0 tx=0).stop 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 shutdown_connections 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4660066550 0x7f4660068a10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f467c0c8310 0x7f467c0c0920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f467c0c7f30 0x7f467c1f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 --2- 172.21.15.133:0/20228400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f467c071970 0x7f467c15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 >> 172.21.15.133:0/20228400 conn(0x7f467c06aa60 msgr2=0x7f467c072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 shutdown_connections 2024-01-19T04:32:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.621+0000 7f46834c0640 1 -- 172.21.15.133:0/20228400 wait complete. 2024-01-19T04:32:11.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T04:32:11.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 Processor -- start 2024-01-19T04:32:11.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 -- start start 2024-01-19T04:32:11.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9440c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:11.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff9440c5580 0x7ff9440c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:11.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440c7c10 con 0x7ff9440c51a0 2024-01-19T04:32:11.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff944159850 con 0x7ff9440c5580 2024-01-19T04:32:11.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff949d80640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944159b30 con 0x7ff9441507a0 2024-01-19T04:32:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff943fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff9440c5580 0x7ff9440c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.777+0000 7ff942ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9440c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.781+0000 7ff942ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9440c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43038/0 (socket says 172.21.15.133:43038) 2024-01-19T04:32:11.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.781+0000 7ff942ffd640 1 -- 172.21.15.133:0/1888893833 learned_addr learned my addr 172.21.15.133:0/1888893833 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:11.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.785+0000 7ff942ffd640 1 -- 172.21.15.133:0/1888893833 >> v2:172.21.15.156:3300/0 conn(0x7ff9440c5580 msgr2=0x7ff9440c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:11.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.785+0000 7ff942ffd640 1 --2- 172.21.15.133:0/1888893833 >> v2:172.21.15.156:3300/0 conn(0x7ff9440c5580 0x7ff9440c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.785+0000 7ff942ffd640 1 -- 172.21.15.133:0/1888893833 >> v1:172.21.15.133:6789/0 conn(0x7ff9440c51a0 legacy=0x7ff944150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:11.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.785+0000 7ff942ffd640 1 -- 172.21.15.133:0/1888893833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944159e10 con 0x7ff9441507a0 2024-01-19T04:32:11.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.789+0000 7ff942ffd640 1 --2- 172.21.15.133:0/1888893833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9440c7620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff934009870 tx=0x7ff93401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e540b59864f27f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff9427fc640 1 -- 172.21.15.133:0/1888893833 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340a89b0 con 0x7ff9441507a0 2024-01-19T04:32:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff9427fc640 1 -- 172.21.15.133:0/1888893833 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9340a8b10 con 0x7ff9441507a0 2024-01-19T04:32:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff9427fc640 1 -- 172.21.15.133:0/1888893833 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340a8ea0 con 0x7ff9441507a0 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 -- 172.21.15.133:0/1888893833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 msgr2=0x7ff9440c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 --2- 172.21.15.133:0/1888893833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9440c7620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff934009870 tx=0x7ff93401ecf0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 -- 172.21.15.133:0/1888893833 shutdown_connections 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 --2- 172.21.15.133:0/1888893833 >> v2:172.21.15.156:3300/0 conn(0x7ff9440c5580 0x7ff9440c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 --2- 172.21.15.133:0/1888893833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9440c7620 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 -- 172.21.15.133:0/1888893833 >> 172.21.15.133:0/1888893833 conn(0x7ff9440cb3e0 msgr2=0x7ff9440cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 -- 172.21.15.133:0/1888893833 shutdown_connections 2024-01-19T04:32:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.841+0000 7ff949d80640 1 -- 172.21.15.133:0/1888893833 wait complete. 2024-01-19T04:32:11.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 Processor -- start 2024-01-19T04:32:11.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 -- start start 2024-01-19T04:32:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9440c51a0 0x7ff944150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c5580 0x7ff94414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9441eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441596a0 con 0x7ff9440c5580 2024-01-19T04:32:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944159210 con 0x7ff9440c51a0 2024-01-19T04:32:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.845+0000 7ff949d80640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944151110 con 0x7ff9441507a0 2024-01-19T04:32:11.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.849+0000 7ff943fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9441eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.853+0000 7ff943fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9441eaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43040/0 (socket says 172.21.15.133:43040) 2024-01-19T04:32:11.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.853+0000 7ff943fff640 1 -- 172.21.15.133:0/4266919091 learned_addr learned my addr 172.21.15.133:0/4266919091 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:11.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.857+0000 7ff942ffd640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c5580 0x7ff94414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:11.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.861+0000 7ff943fff640 1 -- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9440c51a0 msgr2=0x7ff944150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:11.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.861+0000 7ff943fff640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9440c51a0 0x7ff944150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.861+0000 7ff943fff640 1 -- 172.21.15.133:0/4266919091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c5580 msgr2=0x7ff94414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:11.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.861+0000 7ff943fff640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c5580 0x7ff94414a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:11.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.861+0000 7ff943fff640 1 -- 172.21.15.133:0/4266919091 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340094d0 con 0x7ff9441507a0 2024-01-19T04:32:11.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.869+0000 7ff943fff640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9441eaf40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009e30 tx=0x7ff93c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.969+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c009ca0 con 0x7ff9441507a0 2024-01-19T04:32:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.969+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00f040 con 0x7ff9441507a0 2024-01-19T04:32:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.969+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440cac10 con 0x7ff9441507a0 2024-01-19T04:32:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.969+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0146c0 con 0x7ff9441507a0 2024-01-19T04:32:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.969+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff944158bc0 con 0x7ff9441507a0 2024-01-19T04:32:11.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:11.969+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944158a00 con 0x7ff9441507a0 2024-01-19T04:32:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.293+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff93c014820 con 0x7ff9441507a0 2024-01-19T04:32:12.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.297+0000 7ff93bfff640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff924066580 0x7ff924068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:12.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.297+0000 7ff9437fe640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff924066580 0x7ff924068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:12.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.297+0000 7ff9437fe640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff924066580 0x7ff924068a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007fd0 tx=0x7ff92c0079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:12.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.301+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff93c0569e0 con 0x7ff9441507a0 2024-01-19T04:32:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.333+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff93c052620 con 0x7ff9441507a0 2024-01-19T04:32:12.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:12.549+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff94414d3b0 con 0x7ff9441507a0 2024-01-19T04:32:13.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.181+0000 7ff93bfff640 1 -- 172.21.15.133:0/4266919091 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff93c018020 con 0x7ff9441507a0 2024-01-19T04:32:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff924066580 msgr2=0x7ff924068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff924066580 0x7ff924068a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007fd0 tx=0x7ff92c0079a0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 msgr2=0x7ff9441eaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9441eaf40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009e30 tx=0x7ff93c00c490 comp rx=0 tx=0).stop 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 shutdown_connections 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff924066580 0x7ff924068a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441507a0 0x7ff9441eaf40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c5580 0x7ff94414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 --2- 172.21.15.133:0/4266919091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9440c51a0 0x7ff944150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 >> 172.21.15.133:0/4266919091 conn(0x7ff9440cb3e0 msgr2=0x7ff94414eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 shutdown_connections 2024-01-19T04:32:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.185+0000 7ff949d80640 1 -- 172.21.15.133:0/4266919091 wait complete. 2024-01-19T04:32:13.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-19T04:32:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 Processor -- start 2024-01-19T04:32:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 -- start start 2024-01-19T04:32:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21f01503c0 0x7f21f00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21f0072760 0x7f21f0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f0156760 con 0x7f21f00c7cd0 2024-01-19T04:32:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f01507a0 con 0x7f21f01503c0 2024-01-19T04:32:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21f4eee640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f0071a10 con 0x7f21f0072760 2024-01-19T04:32:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21ee59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21f01503c0 0x7f21f00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21ee59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21f01503c0 0x7f21f00c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56218/0 (socket says 172.21.15.133:56218) 2024-01-19T04:32:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21ee59c640 1 -- 172.21.15.133:0/3415044844 learned_addr learned my addr 172.21.15.133:0/3415044844 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.333+0000 7f21edd9b640 1 --2- 172.21.15.133:0/3415044844 >> v2:172.21.15.156:3300/0 conn(0x7f21f0072760 0x7f21f0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.337+0000 7f21ee59c640 1 -- 172.21.15.133:0/3415044844 >> v2:172.21.15.156:3300/0 conn(0x7f21f0072760 msgr2=0x7f21f0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.337+0000 7f21ee59c640 1 --2- 172.21.15.133:0/3415044844 >> v2:172.21.15.156:3300/0 conn(0x7f21f0072760 0x7f21f0156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.337+0000 7f21ee59c640 1 -- 172.21.15.133:0/3415044844 >> v1:172.21.15.133:6789/0 conn(0x7f21f00c7cd0 legacy=0x7f21f01598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.337+0000 7f21ee59c640 1 -- 172.21.15.133:0/3415044844 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0071cf0 con 0x7f21f01503c0 2024-01-19T04:32:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.345+0000 7f21ee59c640 1 --2- 172.21.15.133:0/3415044844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f00c57d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f21f0070670 tx=0x7f21e8020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b450c5df7567ac server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21ed59a640 1 -- 172.21.15.133:0/3415044844 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80aac00 con 0x7f21f01503c0 2024-01-19T04:32:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21ed59a640 1 -- 172.21.15.133:0/3415044844 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80aad60 con 0x7f21f01503c0 2024-01-19T04:32:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21ed59a640 1 -- 172.21.15.133:0/3415044844 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80b2660 con 0x7f21f01503c0 2024-01-19T04:32:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 -- 172.21.15.133:0/3415044844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 msgr2=0x7f21f00c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 --2- 172.21.15.133:0/3415044844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f00c57d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f21f0070670 tx=0x7f21e8020f00 comp rx=0 tx=0).stop 2024-01-19T04:32:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 -- 172.21.15.133:0/3415044844 shutdown_connections 2024-01-19T04:32:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 --2- 172.21.15.133:0/3415044844 >> v2:172.21.15.156:3300/0 conn(0x7f21f0072760 0x7f21f0156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 --2- 172.21.15.133:0/3415044844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f00c57d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 -- 172.21.15.133:0/3415044844 >> 172.21.15.133:0/3415044844 conn(0x7f21f006aa60 msgr2=0x7f21f006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 -- 172.21.15.133:0/3415044844 shutdown_connections 2024-01-19T04:32:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.353+0000 7f21f4eee640 1 -- 172.21.15.133:0/3415044844 wait complete. 2024-01-19T04:32:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 Processor -- start 2024-01-19T04:32:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 -- start start 2024-01-19T04:32:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21f0072760 0x7f21f0146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21f00c7cd0 0x7f21f0152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f0152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00c2280 con 0x7f21f01503c0 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0150d20 con 0x7f21f00c7cd0 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21f4eee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00c2850 con 0x7f21f0072760 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21eed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f0152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21eed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f0152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56224/0 (socket says 172.21.15.133:56224) 2024-01-19T04:32:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21eed9d640 1 -- 172.21.15.133:0/2897918463 learned_addr learned my addr 172.21.15.133:0/2897918463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21edd9b640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21f00c7cd0 0x7f21f0152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.357+0000 7f21ee59c640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21f0072760 0x7f21f0146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:13.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.361+0000 7f21eed9d640 1 -- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21f0072760 msgr2=0x7f21f0146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:13.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.361+0000 7f21eed9d640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21f0072760 0x7f21f0146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.361+0000 7f21eed9d640 1 -- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21f00c7cd0 msgr2=0x7f21f0152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:13.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.361+0000 7f21eed9d640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21f00c7cd0 0x7f21f0152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:13.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.361+0000 7f21eed9d640 1 -- 172.21.15.133:0/2897918463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80094d0 con 0x7f21f01503c0 2024-01-19T04:32:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.361+0000 7f21eed9d640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f0152760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c710 tx=0x7f21e000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:13.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.369+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0006d60 con 0x7f21f01503c0 2024-01-19T04:32:13.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.369+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e000ce20 con 0x7f21f01503c0 2024-01-19T04:32:13.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.369+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f0155020 con 0x7f21f01503c0 2024-01-19T04:32:13.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.369+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0003bc0 con 0x7f21f01503c0 2024-01-19T04:32:13.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.369+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f01555e0 con 0x7f21f01503c0 2024-01-19T04:32:13.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.369+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f0074340 con 0x7f21f01503c0 2024-01-19T04:32:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.389+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f21e0003d20 con 0x7f21f01503c0 2024-01-19T04:32:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.389+0000 7f21e6ffd640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f21d0066550 0x7f21d0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:13.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.389+0000 7f21ee59c640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f21d0066550 0x7f21d0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.389+0000 7f21ee59c640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f21d0066550 0x7f21d0068a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f21e80b4000 tx=0x7f21e80ac070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:13.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.637+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21e0055740 con 0x7f21f01503c0 2024-01-19T04:32:13.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.637+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f21e0055510 con 0x7f21f01503c0 2024-01-19T04:32:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:13.837+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f21f0067730 con 0x7f21f01503c0 2024-01-19T04:32:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.541+0000 7f21e6ffd640 1 -- 172.21.15.133:0/2897918463 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f21e00550a0 con 0x7f21f01503c0 2024-01-19T04:32:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f21d0066550 msgr2=0x7f21d0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f21d0066550 0x7f21d0068a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f21e80b4000 tx=0x7f21e80ac070 comp rx=0 tx=0).stop 2024-01-19T04:32:14.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 msgr2=0x7f21f0152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f0152760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c710 tx=0x7f21e000cbd0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 shutdown_connections 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f21d0066550 0x7f21d0068a10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21f00c7cd0 0x7f21f0152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f01503c0 0x7f21f0152760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 --2- 172.21.15.133:0/2897918463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21f0072760 0x7f21f0146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 >> 172.21.15.133:0/2897918463 conn(0x7f21f006aa60 msgr2=0x7f21f00c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 shutdown_connections 2024-01-19T04:32:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.545+0000 7f21f4eee640 1 -- 172.21.15.133:0/2897918463 wait complete. 2024-01-19T04:32:14.569 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T04:32:14.569 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:32:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 Processor -- start 2024-01-19T04:32:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 -- start start 2024-01-19T04:32:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b0c151620 0x7f8b0c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c06b670 0x7f8b0c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c0709d0 con 0x7f8b0c0c6770 2024-01-19T04:32:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c158410 con 0x7f8b0c151620 2024-01-19T04:32:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b145b4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c1575b0 con 0x7f8b0c06b670 2024-01-19T04:32:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b12350640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b0c151620 0x7f8b0c15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b11b4f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8b0c0c6770 0x7f8b0c06dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39360/0 (socket says 172.21.15.133:39360) 2024-01-19T04:32:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b11b4f640 1 -- 172.21.15.133:0/4145400554 learned_addr learned my addr 172.21.15.133:0/4145400554 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.701+0000 7f8b12b51640 1 --2- 172.21.15.133:0/4145400554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c06b670 0x7f8b0c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.705+0000 7f8b12350640 1 -- 172.21.15.133:0/4145400554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c06b670 msgr2=0x7f8b0c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.705+0000 7f8b12350640 1 --2- 172.21.15.133:0/4145400554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c06b670 0x7f8b0c15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.705+0000 7f8b12350640 1 -- 172.21.15.133:0/4145400554 >> v1:172.21.15.133:6789/0 conn(0x7f8b0c0c6770 legacy=0x7f8b0c06dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.705+0000 7f8b12350640 1 -- 172.21.15.133:0/4145400554 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c157890 con 0x7f8b0c151620 2024-01-19T04:32:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.713+0000 7f8b12350640 1 --2- 172.21.15.133:0/4145400554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c151620 0x7f8b0c15ad70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b080097c0 tx=0x7f8b0801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8122ea0231d8fa95 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b1134e640 1 -- 172.21.15.133:0/4145400554 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080ab600 con 0x7f8b0c151620 2024-01-19T04:32:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b1134e640 1 -- 172.21.15.133:0/4145400554 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b080a7050 con 0x7f8b0c151620 2024-01-19T04:32:14.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b1134e640 1 -- 172.21.15.133:0/4145400554 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080ab980 con 0x7f8b0c151620 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 -- 172.21.15.133:0/4145400554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c151620 msgr2=0x7f8b0c15ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 --2- 172.21.15.133:0/4145400554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c151620 0x7f8b0c15ad70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b080097c0 tx=0x7f8b0801c480 comp rx=0 tx=0).stop 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 -- 172.21.15.133:0/4145400554 shutdown_connections 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 --2- 172.21.15.133:0/4145400554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c06b670 0x7f8b0c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 --2- 172.21.15.133:0/4145400554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c151620 0x7f8b0c15ad70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 -- 172.21.15.133:0/4145400554 >> 172.21.15.133:0/4145400554 conn(0x7f8b0c072450 msgr2=0x7f8b0c06fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 -- 172.21.15.133:0/4145400554 shutdown_connections 2024-01-19T04:32:14.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.717+0000 7f8b145b4640 1 -- 172.21.15.133:0/4145400554 wait complete. 2024-01-19T04:32:14.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 Processor -- start 2024-01-19T04:32:14.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 -- start start 2024-01-19T04:32:14.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 0x7f8b0c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:14.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c0c6770 0x7f8b0c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:14.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0c151620 0x7f8b0c0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:14.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c1f6560 con 0x7f8b0c06b670 2024-01-19T04:32:14.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c14c730 con 0x7f8b0c151620 2024-01-19T04:32:14.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b145b4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c14d950 con 0x7f8b0c0c6770 2024-01-19T04:32:14.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b12350640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 0x7f8b0c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:14.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b12350640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 0x7f8b0c13fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56234/0 (socket says 172.21.15.133:56234) 2024-01-19T04:32:14.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b12350640 1 -- 172.21.15.133:0/355140904 learned_addr learned my addr 172.21.15.133:0/355140904 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:14.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b11b4f640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c0c6770 0x7f8b0c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:14.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.721+0000 7f8b12b51640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0c151620 0x7f8b0c0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:14.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.725+0000 7f8b12350640 1 -- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c0c6770 msgr2=0x7f8b0c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:14.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.725+0000 7f8b12350640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c0c6770 0x7f8b0c1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.725+0000 7f8b12350640 1 -- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0c151620 msgr2=0x7f8b0c0ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:14.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.725+0000 7f8b12350640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0c151620 0x7f8b0c0ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:14.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.725+0000 7f8b12350640 1 -- 172.21.15.133:0/355140904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009420 con 0x7f8b0c06b670 2024-01-19T04:32:14.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.729+0000 7f8b12350640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 0x7f8b0c13fd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b0801ab30 tx=0x7f8b08019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:14.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.733+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080b4600 con 0x7f8b0c06b670 2024-01-19T04:32:14.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.733+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b080b4760 con 0x7f8b0c06b670 2024-01-19T04:32:14.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.733+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080b4b10 con 0x7f8b0c06b670 2024-01-19T04:32:14.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.733+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c1f60d0 con 0x7f8b0c06b670 2024-01-19T04:32:14.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.733+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c14d670 con 0x7f8b0c06b670 2024-01-19T04:32:14.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.733+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c074340 con 0x7f8b0c06b670 2024-01-19T04:32:14.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.753+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8b080b2040 con 0x7f8b0c06b670 2024-01-19T04:32:14.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.753+0000 7f8b02ffd640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8af0066580 0x7f8af0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:14.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.753+0000 7f8b11b4f640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8af0066580 0x7f8af0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:14.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:14.753+0000 7f8b11b4f640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8af0066580 0x7f8af0068a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0ca250 tx=0x7f8afc007e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:15.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.013+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b080abe20 con 0x7f8b0c06b670 2024-01-19T04:32:15.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.013+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8b080eb530 con 0x7f8b0c06b670 2024-01-19T04:32:15.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.205+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b0c0c7570 con 0x7f8b0c06b670 2024-01-19T04:32:15.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.225+0000 7f8b02ffd640 1 -- 172.21.15.133:0/355140904 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6546 (secure 0 0 0) 0x7f8b080b0070 con 0x7f8b0c06b670 2024-01-19T04:32:15.227 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:15.227 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:32:13.850112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4247,"mds_1":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":1,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:32:15.227 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 13 2024-01-19T04:32:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8af0066580 msgr2=0x7f8af0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8af0066580 0x7f8af0068a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0ca250 tx=0x7f8afc007e90 comp rx=0 tx=0).stop 2024-01-19T04:32:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 msgr2=0x7f8b0c13fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 0x7f8b0c13fd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b0801ab30 tx=0x7f8b08019220 comp rx=0 tx=0).stop 2024-01-19T04:32:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 shutdown_connections 2024-01-19T04:32:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8af0066580 0x7f8af0068a40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0c151620 0x7f8b0c0ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b0c0c6770 0x7f8b0c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 --2- 172.21.15.133:0/355140904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b0c06b670 0x7f8b0c13fd60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 >> 172.21.15.133:0/355140904 conn(0x7f8b0c072450 msgr2=0x7f8b0c14ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 shutdown_connections 2024-01-19T04:32:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.229+0000 7f8b145b4640 1 -- 172.21.15.133:0/355140904 wait complete. 2024-01-19T04:32:15.248 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:15.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.361+0000 7f90b6385640 1 Processor -- start 2024-01-19T04:32:15.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.361+0000 7f90b6385640 1 -- start start 2024-01-19T04:32:15.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b6385640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90b006f350 0x7f90b015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:15.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b6385640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0158390 con 0x7f90b0151600 2024-01-19T04:32:15.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b6385640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b015b0e0 con 0x7f90b01519e0 2024-01-19T04:32:15.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b6385640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b0157b70 con 0x7f90b006f350 2024-01-19T04:32:15.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b4922640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90b006f350 0x7f90b015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:15.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b4922640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90b006f350 0x7f90b015b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56240/0 (socket says 172.21.15.133:56240) 2024-01-19T04:32:15.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.365+0000 7f90b4922640 1 -- 172.21.15.133:0/1543649510 learned_addr learned my addr 172.21.15.133:0/1543649510 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:15.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.369+0000 7f90b4922640 1 -- 172.21.15.133:0/1543649510 >> v1:172.21.15.156:6789/0 conn(0x7f90b01519e0 legacy=0x7f90b00cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.369+0000 7f90b4922640 1 -- 172.21.15.133:0/1543649510 >> v1:172.21.15.133:6789/0 conn(0x7f90b0151600 legacy=0x7f90b0157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.369+0000 7f90b4922640 1 -- 172.21.15.133:0/1543649510 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0157dd0 con 0x7f90b006f350 2024-01-19T04:32:15.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.373+0000 7f90b4922640 1 --2- 172.21.15.133:0/1543649510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b015b570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009870 tx=0x7f90a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de85a70ab736f00 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:15.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90aeffd640 1 -- 172.21.15.133:0/1543649510 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80aa670 con 0x7f90b006f350 2024-01-19T04:32:15.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90aeffd640 1 -- 172.21.15.133:0/1543649510 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a80aa7d0 con 0x7f90b006f350 2024-01-19T04:32:15.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90aeffd640 1 -- 172.21.15.133:0/1543649510 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80aab60 con 0x7f90b006f350 2024-01-19T04:32:15.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90b6385640 1 -- 172.21.15.133:0/1543649510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 msgr2=0x7f90b015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90b6385640 1 --2- 172.21.15.133:0/1543649510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b015b570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009870 tx=0x7f90a801c510 comp rx=0 tx=0).stop 2024-01-19T04:32:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90b6385640 1 -- 172.21.15.133:0/1543649510 shutdown_connections 2024-01-19T04:32:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90b6385640 1 --2- 172.21.15.133:0/1543649510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b015b570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.377+0000 7f90b6385640 1 -- 172.21.15.133:0/1543649510 >> 172.21.15.133:0/1543649510 conn(0x7f90b006d590 msgr2=0x7f90b0066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 -- 172.21.15.133:0/1543649510 shutdown_connections 2024-01-19T04:32:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 -- 172.21.15.133:0/1543649510 wait complete. 2024-01-19T04:32:15.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 Processor -- start 2024-01-19T04:32:15.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 -- start start 2024-01-19T04:32:15.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b0158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:15.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90b0151600 0x7f90b00c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:15.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90b0156f10 0x7f90b00c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:15.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b015a700 con 0x7f90b006f350 2024-01-19T04:32:15.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00c44f0 con 0x7f90b0151600 2024-01-19T04:32:15.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b6385640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00c4790 con 0x7f90b0156f10 2024-01-19T04:32:15.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90affff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b0158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90affff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b0158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56244/0 (socket says 172.21.15.133:56244) 2024-01-19T04:32:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90affff640 1 -- 172.21.15.133:0/1725936795 learned_addr learned my addr 172.21.15.133:0/1725936795 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.381+0000 7f90b4922640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90b0156f10 0x7f90b00c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:15.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.385+0000 7f90affff640 1 -- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90b0156f10 msgr2=0x7f90b00c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.385+0000 7f90affff640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90b0156f10 0x7f90b00c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.385+0000 7f90affff640 1 -- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90b0151600 msgr2=0x7f90b00c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.385+0000 7f90affff640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90b0151600 0x7f90b00c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.385+0000 7f90affff640 1 -- 172.21.15.133:0/1725936795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80094d0 con 0x7f90b006f350 2024-01-19T04:32:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.389+0000 7f90affff640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b0158860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c7f0 tx=0x7f90a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.393+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003b80 con 0x7f90b006f350 2024-01-19T04:32:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.397+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0003ce0 con 0x7f90b006f350 2024-01-19T04:32:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.397+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b0159b10 con 0x7f90b006f350 2024-01-19T04:32:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.397+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000aa90 con 0x7f90b006f350 2024-01-19T04:32:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.397+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b015a0b0 con 0x7f90b006f350 2024-01-19T04:32:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.397+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b0071fa0 con 0x7f90b006f350 2024-01-19T04:32:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.417+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f90a000abf0 con 0x7f90b006f350 2024-01-19T04:32:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.417+0000 7f90acff9640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9090066580 0x7f9090068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.417+0000 7f90af7fe640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9090066580 0x7f9090068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.417+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90a0055d90 con 0x7f90b006f350 2024-01-19T04:32:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.417+0000 7f90af7fe640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9090066580 0x7f9090068a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9098000f70 tx=0x7f90980079e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.693+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f90a00519d0 con 0x7f90b006f350 2024-01-19T04:32:15.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.857+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b0074340 con 0x7f90b006f350 2024-01-19T04:32:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.961+0000 7f90acff9640 1 -- 172.21.15.133:0/1725936795 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f90a0054ff0 con 0x7f90b006f350 2024-01-19T04:32:15.963 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:15.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9090066580 msgr2=0x7f9090068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9090066580 0x7f9090068a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9098000f70 tx=0x7f90980079e0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 msgr2=0x7f90b0158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b0158860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c7f0 tx=0x7f90a000ccb0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 shutdown_connections 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9090066580 0x7f9090068a40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90b0151600 0x7f90b00c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90b0156f10 0x7f90b00c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 --2- 172.21.15.133:0/1725936795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b006f350 0x7f90b0158860 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 >> 172.21.15.133:0/1725936795 conn(0x7f90b006d590 msgr2=0x7f90b0066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 shutdown_connections 2024-01-19T04:32:15.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:15.965+0000 7f90b6385640 1 -- 172.21.15.133:0/1725936795 wait complete. 2024-01-19T04:32:15.988 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:32:15.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:32:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a9e829640 1 Processor -- start 2024-01-19T04:32:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a9e829640 1 -- start start 2024-01-19T04:32:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a9e829640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5a981593e0 0x7f5a98159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a9e829640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a98072ce0 con 0x7f5a9814fa50 2024-01-19T04:32:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a9e829640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980c05f0 con 0x7f5a980c7790 2024-01-19T04:32:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a9e829640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a98155a30 con 0x7f5a981593e0 2024-01-19T04:32:16.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a97fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5a9814fa50 0x7f5a980710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39368/0 (socket says 172.21.15.133:39368) 2024-01-19T04:32:16.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.113+0000 7f5a97fff640 1 -- 172.21.15.133:0/458493694 learned_addr learned my addr 172.21.15.133:0/458493694 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:16.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.117+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238338635 0 0) 0x7f5a98072ce0 con 0x7f5a9814fa50 2024-01-19T04:32:16.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.117+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a84003450 con 0x7f5a9814fa50 2024-01-19T04:32:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623565976 0 0) 0x7f5a84003450 con 0x7f5a9814fa50 2024-01-19T04:32:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 >> v2:172.21.15.156:3300/0 conn(0x7f5a981593e0 msgr2=0x7f5a98159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 --2- 172.21.15.133:0/458493694 >> v2:172.21.15.156:3300/0 conn(0x7f5a981593e0 0x7f5a98159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 >> v1:172.21.15.156:6789/0 conn(0x7f5a980c7790 legacy=0x7f5a980c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98159d90 con 0x7f5a9814fa50 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f5a88001680 con 0x7f5a9814fa50 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 >> v1:172.21.15.133:6789/0 conn(0x7f5a9814fa50 legacy=0x7f5a980710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a84003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a840089f0 0x7f5a8400ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8400b660 0x7f5a8400db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98155a30 con 0x7f5a840089f0 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8400e400 con 0x7f5a84003ac0 2024-01-19T04:32:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8400e5c0 con 0x7f5a8400b660 2024-01-19T04:32:16.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.121+0000 7f5a8ffff640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a840089f0 0x7f5a8400ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.129+0000 7f5a97fff640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a84003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.137+0000 7f5a97fff640 1 -- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8400b660 msgr2=0x7f5a8400db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:16.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.137+0000 7f5a97fff640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8400b660 0x7f5a8400db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.137+0000 7f5a97fff640 1 -- 172.21.15.133:0/458493694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a840089f0 msgr2=0x7f5a8400ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:16.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.137+0000 7f5a97fff640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a840089f0 0x7f5a8400ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.137+0000 7f5a97fff640 1 -- 172.21.15.133:0/458493694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a84003450 con 0x7f5a84003ac0 2024-01-19T04:32:16.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.137+0000 7f5a9cdc6640 1 -- 172.21.15.133:0/458493694 reap_dead start 2024-01-19T04:32:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.145+0000 7f5a97fff640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a84003ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c110 tx=0x7f5a8801f2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b365fde70c6b5efb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:16.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.153+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880058e0 con 0x7f5a84003ac0 2024-01-19T04:32:16.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.153+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88005a40 con 0x7f5a84003ac0 2024-01-19T04:32:16.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.153+0000 7f5a977fe640 1 -- 172.21.15.133:0/458493694 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88005e70 con 0x7f5a84003ac0 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 msgr2=0x7f5a84003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a84003ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c110 tx=0x7f5a8801f2d0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- 172.21.15.133:0/458493694 shutdown_connections 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 --2- 172.21.15.133:0/458493694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a84003ec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- 172.21.15.133:0/458493694 >> 172.21.15.133:0/458493694 conn(0x7f5a9806d590 msgr2=0x7f5a98066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- 172.21.15.133:0/458493694 shutdown_connections 2024-01-19T04:32:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- 172.21.15.133:0/458493694 wait complete. 2024-01-19T04:32:16.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 Processor -- start 2024-01-19T04:32:16.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- start start 2024-01-19T04:32:16.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a9814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a98143d30 0x7f5a9814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 0x7f5a9814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814ef90 con 0x7f5a9814dec0 2024-01-19T04:32:16.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814acf0 con 0x7f5a84003ac0 2024-01-19T04:32:16.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.157+0000 7f5a9e829640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9814afb0 con 0x7f5a98143d30 2024-01-19T04:32:16.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.161+0000 7f5a9cdc6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 0x7f5a9814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.161+0000 7f5a9cdc6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 0x7f5a9814e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56258/0 (socket says 172.21.15.133:56258) 2024-01-19T04:32:16.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.161+0000 7f5a9cdc6640 1 -- 172.21.15.133:0/1767825190 learned_addr learned my addr 172.21.15.133:0/1767825190 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:16.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.165+0000 7f5a9cdc6640 1 -- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a98143d30 msgr2=0x7f5a9814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.165+0000 7f5a9cdc6640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a98143d30 0x7f5a9814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.165+0000 7f5a9cdc6640 1 -- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 msgr2=0x7f5a9814d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.165+0000 7f5a9cdc6640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a9814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.165+0000 7f5a9cdc6640 1 -- 172.21.15.133:0/1767825190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9814d8c0 con 0x7f5a9814dec0 2024-01-19T04:32:16.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.165+0000 7f5a9cdc6640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 0x7f5a9814e350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a980cbe90 tx=0x7f5a9000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.169+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90007070 con 0x7f5a9814dec0 2024-01-19T04:32:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.169+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a900071d0 con 0x7f5a9814dec0 2024-01-19T04:32:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.169+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90007580 con 0x7f5a9814dec0 2024-01-19T04:32:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.169+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9814e9d0 con 0x7f5a9814dec0 2024-01-19T04:32:16.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.169+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9814a570 con 0x7f5a9814dec0 2024-01-19T04:32:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.173+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a98074340 con 0x7f5a9814dec0 2024-01-19T04:32:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.193+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5a900076e0 con 0x7f5a9814dec0 2024-01-19T04:32:16.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.193+0000 7f5a957fa640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5a78066550 0x7f5a78068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.193+0000 7f5a97fff640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5a78066550 0x7f5a78068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.193+0000 7f5a97fff640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5a78066550 0x7f5a78068a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a880ae000 tx=0x7f5a980c00f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:16.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.465+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a9000f260 con 0x7f5a9814dec0 2024-01-19T04:32:16.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.465+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5a90050b40 con 0x7f5a9814dec0 2024-01-19T04:32:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.629+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a980c0770 con 0x7f5a78066550 2024-01-19T04:32:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.661+0000 7f5a957fa640 1 -- 172.21.15.133:0/1767825190 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368587 (secure 0 0 0) 0x7f5a980c0770 con 0x7f5a78066550 2024-01-19T04:32:16.669 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5a78066550 msgr2=0x7f5a78068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5a78066550 0x7f5a78068a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5a880ae000 tx=0x7f5a980c00f0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 msgr2=0x7f5a9814e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 0x7f5a9814e350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a980cbe90 tx=0x7f5a9000c980 comp rx=0 tx=0).stop 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 shutdown_connections 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5a78066550 0x7f5a78068a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a9814dec0 0x7f5a9814e350 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a98143d30 0x7f5a9814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 --2- 172.21.15.133:0/1767825190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a84003ac0 0x7f5a9814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 >> 172.21.15.133:0/1767825190 conn(0x7f5a9806d590 msgr2=0x7f5a98066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 shutdown_connections 2024-01-19T04:32:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.669+0000 7f5a9e829640 1 -- 172.21.15.133:0/1767825190 wait complete. 2024-01-19T04:32:16.689 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-01-19T04:32:15.618235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596391,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240496,"kb_used_data":3556,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734224,"statfs":{"total":773094113280,"available":772847845376,"internally_reserved":0,"allocated":3641344,"data_stored":2139862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1525,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005241"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726836+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T04:31:39.726836+0000","last_peered":"2024-01-19T04:31:39.726836+0000","last_clean":"2024-01-19T04:31:39.726836+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T04:31:39.726836+0000","last_undegraded":"2024-01-19T04:31:39.726836+0000","last_fullsized":"2024-01-19T04:31:39.726836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821877+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T04:31:39.821877+0000","last_peered":"2024-01-19T04:31:39.821877+0000","last_clean":"2024-01-19T04:31:39.821877+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T04:31:39.821877+0000","last_undegraded":"2024-01-19T04:31:39.821877+0000","last_fullsized":"2024-01-19T04:31:39.821877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646153+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T04:31:41.646153+0000","last_peered":"2024-01-19T04:31:41.646153+0000","last_clean":"2024-01-19T04:31:41.646153+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T04:31:41.646153+0000","last_undegraded":"2024-01-19T04:31:41.646153+0000","last_fullsized":"2024-01-19T04:31:41.646153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822053+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T04:31:39.822053+0000","last_peered":"2024-01-19T04:31:39.822053+0000","last_clean":"2024-01-19T04:31:39.822053+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T04:31:39.822053+0000","last_undegraded":"2024-01-19T04:31:39.822053+0000","last_fullsized":"2024-01-19T04:31:39.822053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726714+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T04:31:39.726714+0000","last_peered":"2024-01-19T04:31:39.726714+0000","last_clean":"2024-01-19T04:31:39.726714+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T04:31:39.726714+0000","last_undegraded":"2024-01-19T04:31:39.726714+0000","last_fullsized":"2024-01-19T04:31:39.726714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217797+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T04:31:42.217797+0000","last_peered":"2024-01-19T04:31:42.217797+0000","last_clean":"2024-01-19T04:31:42.217797+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T04:31:42.217797+0000","last_undegraded":"2024-01-19T04:31:42.217797+0000","last_fullsized":"2024-01-19T04:31:42.217797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979117+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T04:31:40.979117+0000","last_peered":"2024-01-19T04:31:40.979117+0000","last_clean":"2024-01-19T04:31:40.979117+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T04:31:40.979117+0000","last_undegraded":"2024-01-19T04:31:40.979117+0000","last_fullsized":"2024-01-19T04:31:40.979117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667121+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T04:31:39.667121+0000","last_peered":"2024-01-19T04:31:39.667121+0000","last_clean":"2024-01-19T04:31:39.667121+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T04:31:39.667121+0000","last_undegraded":"2024-01-19T04:31:39.667121+0000","last_fullsized":"2024-01-19T04:31:39.667121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223120+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T04:31:42.223120+0000","last_peered":"2024-01-19T04:31:42.223120+0000","last_clean":"2024-01-19T04:31:42.223120+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T04:31:42.223120+0000","last_undegraded":"2024-01-19T04:31:42.223120+0000","last_fullsized":"2024-01-19T04:31:42.223120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978611+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T04:31:40.978611+0000","last_peered":"2024-01-19T04:31:40.978611+0000","last_clean":"2024-01-19T04:31:40.978611+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T04:31:40.978611+0000","last_undegraded":"2024-01-19T04:31:40.978611+0000","last_fullsized":"2024-01-19T04:31:40.978611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667803+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T04:31:39.667803+0000","last_peered":"2024-01-19T04:31:39.667803+0000","last_clean":"2024-01-19T04:31:39.667803+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T04:31:39.667803+0000","last_undegraded":"2024-01-19T04:31:39.667803+0000","last_fullsized":"2024-01-19T04:31:39.667803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218929+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T04:31:42.218929+0000","last_peered":"2024-01-19T04:31:42.218929+0000","last_clean":"2024-01-19T04:31:42.218929+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T04:31:42.218929+0000","last_undegraded":"2024-01-19T04:31:42.218929+0000","last_fullsized":"2024-01-19T04:31:42.218929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.010875+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T04:31:41.010875+0000","last_peered":"2024-01-19T04:31:41.010875+0000","last_clean":"2024-01-19T04:31:41.010875+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T04:31:41.010875+0000","last_undegraded":"2024-01-19T04:31:41.010875+0000","last_fullsized":"2024-01-19T04:31:41.010875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979488+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T04:31:40.979488+0000","last_peered":"2024-01-19T04:31:40.979488+0000","last_clean":"2024-01-19T04:31:40.979488+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T04:31:40.979488+0000","last_undegraded":"2024-01-19T04:31:40.979488+0000","last_fullsized":"2024-01-19T04:31:40.979488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222921+0000","last_change":"2024-01-19T04:31:39.820690+0000","last_active":"2024-01-19T04:31:42.222921+0000","last_peered":"2024-01-19T04:31:42.222921+0000","last_clean":"2024-01-19T04:31:42.222921+0000","last_became_active":"2024-01-19T04:31:39.820114+0000","last_became_peered":"2024-01-19T04:31:39.820114+0000","last_unstale":"2024-01-19T04:31:42.222921+0000","last_undegraded":"2024-01-19T04:31:42.222921+0000","last_fullsized":"2024-01-19T04:31:42.222921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817855+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T04:31:39.817855+0000","last_peered":"2024-01-19T04:31:39.817855+0000","last_clean":"2024-01-19T04:31:39.817855+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T04:31:39.817855+0000","last_undegraded":"2024-01-19T04:31:39.817855+0000","last_fullsized":"2024-01-19T04:31:39.817855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821707+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T04:31:39.821707+0000","last_peered":"2024-01-19T04:31:39.821707+0000","last_clean":"2024-01-19T04:31:39.821707+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T04:31:39.821707+0000","last_undegraded":"2024-01-19T04:31:39.821707+0000","last_fullsized":"2024-01-19T04:31:39.821707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.219094+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T04:31:42.219094+0000","last_peered":"2024-01-19T04:31:42.219094+0000","last_clean":"2024-01-19T04:31:42.219094+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T04:31:42.219094+0000","last_undegraded":"2024-01-19T04:31:42.219094+0000","last_fullsized":"2024-01-19T04:31:42.219094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813733+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T04:31:39.813733+0000","last_peered":"2024-01-19T04:31:39.813733+0000","last_clean":"2024-01-19T04:31:39.813733+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T04:31:39.813733+0000","last_undegraded":"2024-01-19T04:31:39.813733+0000","last_fullsized":"2024-01-19T04:31:39.813733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.070096+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T04:32:13.070096+0000","last_peered":"2024-01-19T04:32:13.070096+0000","last_clean":"2024-01-19T04:32:13.070096+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T04:32:13.070096+0000","last_undegraded":"2024-01-19T04:32:13.070096+0000","last_fullsized":"2024-01-19T04:32:13.070096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286153+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T04:31:41.286153+0000","last_peered":"2024-01-19T04:31:41.286153+0000","last_clean":"2024-01-19T04:31:41.286153+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T04:31:41.286153+0000","last_undegraded":"2024-01-19T04:31:41.286153+0000","last_fullsized":"2024-01-19T04:31:41.286153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103858+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T04:31:41.103858+0000","last_peered":"2024-01-19T04:31:41.103858+0000","last_clean":"2024-01-19T04:31:41.103858+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T04:31:41.103858+0000","last_undegraded":"2024-01-19T04:31:41.103858+0000","last_fullsized":"2024-01-19T04:31:41.103858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.977928+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T04:31:40.977928+0000","last_peered":"2024-01-19T04:31:40.977928+0000","last_clean":"2024-01-19T04:31:40.977928+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T04:31:40.977928+0000","last_undegraded":"2024-01-19T04:31:40.977928+0000","last_fullsized":"2024-01-19T04:31:40.977928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218706+0000","last_change":"2024-01-19T04:31:39.836900+0000","last_active":"2024-01-19T04:31:42.218706+0000","last_peered":"2024-01-19T04:31:42.218706+0000","last_clean":"2024-01-19T04:31:42.218706+0000","last_became_active":"2024-01-19T04:31:39.834989+0000","last_became_peered":"2024-01-19T04:31:39.834989+0000","last_unstale":"2024-01-19T04:31:42.218706+0000","last_undegraded":"2024-01-19T04:31:42.218706+0000","last_fullsized":"2024-01-19T04:31:42.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:18.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726309+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T04:31:39.726309+0000","last_peered":"2024-01-19T04:31:39.726309+0000","last_clean":"2024-01-19T04:31:39.726309+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T04:31:39.726309+0000","last_undegraded":"2024-01-19T04:31:39.726309+0000","last_fullsized":"2024-01-19T04:31:39.726309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934913+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T04:32:12.934913+0000","last_peered":"2024-01-19T04:32:12.934913+0000","last_clean":"2024-01-19T04:32:12.934913+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T04:32:12.934913+0000","last_undegraded":"2024-01-19T04:32:12.934913+0000","last_fullsized":"2024-01-19T04:32:12.934913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218365+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T04:31:42.218365+0000","last_peered":"2024-01-19T04:31:42.218365+0000","last_clean":"2024-01-19T04:31:42.218365+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T04:31:42.218365+0000","last_undegraded":"2024-01-19T04:31:42.218365+0000","last_fullsized":"2024-01-19T04:31:42.218365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821854+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T04:31:39.821854+0000","last_peered":"2024-01-19T04:31:39.821854+0000","last_clean":"2024-01-19T04:31:39.821854+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T04:31:39.821854+0000","last_undegraded":"2024-01-19T04:31:39.821854+0000","last_fullsized":"2024-01-19T04:31:39.821854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822760+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T04:31:39.822760+0000","last_peered":"2024-01-19T04:31:39.822760+0000","last_clean":"2024-01-19T04:31:39.822760+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T04:31:39.822760+0000","last_undegraded":"2024-01-19T04:31:39.822760+0000","last_fullsized":"2024-01-19T04:31:39.822760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.645798+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T04:31:41.645798+0000","last_peered":"2024-01-19T04:31:41.645798+0000","last_clean":"2024-01-19T04:31:41.645798+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T04:31:41.645798+0000","last_undegraded":"2024-01-19T04:31:41.645798+0000","last_fullsized":"2024-01-19T04:31:41.645798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821924+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T04:31:39.821924+0000","last_peered":"2024-01-19T04:31:39.821924+0000","last_clean":"2024-01-19T04:31:39.821924+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T04:31:39.821924+0000","last_undegraded":"2024-01-19T04:31:39.821924+0000","last_fullsized":"2024-01-19T04:31:39.821924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979346+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T04:31:40.979346+0000","last_peered":"2024-01-19T04:31:40.979346+0000","last_clean":"2024-01-19T04:31:40.979346+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T04:31:40.979346+0000","last_undegraded":"2024-01-19T04:31:40.979346+0000","last_fullsized":"2024-01-19T04:31:40.979346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.215923+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T04:31:42.215923+0000","last_peered":"2024-01-19T04:31:42.215923+0000","last_clean":"2024-01-19T04:31:42.215923+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T04:31:42.215923+0000","last_undegraded":"2024-01-19T04:31:42.215923+0000","last_fullsized":"2024-01-19T04:31:42.215923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667922+0000","last_change":"2024-01-19T04:31:34.735885+0000","last_active":"2024-01-19T04:31:39.667922+0000","last_peered":"2024-01-19T04:31:39.667922+0000","last_clean":"2024-01-19T04:31:39.667922+0000","last_became_active":"2024-01-19T04:31:34.735325+0000","last_became_peered":"2024-01-19T04:31:34.735325+0000","last_unstale":"2024-01-19T04:31:39.667922+0000","last_undegraded":"2024-01-19T04:31:39.667922+0000","last_fullsized":"2024-01-19T04:31:39.667922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:04.694015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822020+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T04:31:39.822020+0000","last_peered":"2024-01-19T04:31:39.822020+0000","last_clean":"2024-01-19T04:31:39.822020+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T04:31:39.822020+0000","last_undegraded":"2024-01-19T04:31:39.822020+0000","last_fullsized":"2024-01-19T04:31:39.822020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.284616+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T04:31:41.284616+0000","last_peered":"2024-01-19T04:31:41.284616+0000","last_clean":"2024-01-19T04:31:41.284616+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T04:31:41.284616+0000","last_undegraded":"2024-01-19T04:31:41.284616+0000","last_fullsized":"2024-01-19T04:31:41.284616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103444+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T04:31:41.103444+0000","last_peered":"2024-01-19T04:31:41.103444+0000","last_clean":"2024-01-19T04:31:41.103444+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T04:31:41.103444+0000","last_undegraded":"2024-01-19T04:31:41.103444+0000","last_fullsized":"2024-01-19T04:31:41.103444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666812+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T04:31:39.666812+0000","last_peered":"2024-01-19T04:31:39.666812+0000","last_clean":"2024-01-19T04:31:39.666812+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T04:31:39.666812+0000","last_undegraded":"2024-01-19T04:31:39.666812+0000","last_fullsized":"2024-01-19T04:31:39.666812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286942+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T04:31:41.286942+0000","last_peered":"2024-01-19T04:31:41.286942+0000","last_clean":"2024-01-19T04:31:41.286942+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T04:31:41.286942+0000","last_undegraded":"2024-01-19T04:31:41.286942+0000","last_fullsized":"2024-01-19T04:31:41.286942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820565+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T04:31:39.820565+0000","last_peered":"2024-01-19T04:31:39.820565+0000","last_clean":"2024-01-19T04:31:39.820565+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T04:31:39.820565+0000","last_undegraded":"2024-01-19T04:31:39.820565+0000","last_fullsized":"2024-01-19T04:31:39.820565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275170+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T04:31:41.275170+0000","last_peered":"2024-01-19T04:31:41.275170+0000","last_clean":"2024-01-19T04:31:41.275170+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T04:31:41.275170+0000","last_undegraded":"2024-01-19T04:31:41.275170+0000","last_fullsized":"2024-01-19T04:31:41.275170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286650+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T04:31:41.286650+0000","last_peered":"2024-01-19T04:31:41.286650+0000","last_clean":"2024-01-19T04:31:41.286650+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T04:31:41.286650+0000","last_undegraded":"2024-01-19T04:31:41.286650+0000","last_fullsized":"2024-01-19T04:31:41.286650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724790+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T04:31:39.724790+0000","last_peered":"2024-01-19T04:31:39.724790+0000","last_clean":"2024-01-19T04:31:39.724790+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T04:31:39.724790+0000","last_undegraded":"2024-01-19T04:31:39.724790+0000","last_fullsized":"2024-01-19T04:31:39.724790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.977977+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T04:31:40.977977+0000","last_peered":"2024-01-19T04:31:40.977977+0000","last_clean":"2024-01-19T04:31:40.977977+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T04:31:40.977977+0000","last_undegraded":"2024-01-19T04:31:40.977977+0000","last_fullsized":"2024-01-19T04:31:40.977977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216628+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T04:31:42.216628+0000","last_peered":"2024-01-19T04:31:42.216628+0000","last_clean":"2024-01-19T04:31:42.216628+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T04:31:42.216628+0000","last_undegraded":"2024-01-19T04:31:42.216628+0000","last_fullsized":"2024-01-19T04:31:42.216628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817644+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T04:31:39.817644+0000","last_peered":"2024-01-19T04:31:39.817644+0000","last_clean":"2024-01-19T04:31:39.817644+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T04:31:39.817644+0000","last_undegraded":"2024-01-19T04:31:39.817644+0000","last_fullsized":"2024-01-19T04:31:39.817644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.944785+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T04:32:12.944785+0000","last_peered":"2024-01-19T04:32:12.944785+0000","last_clean":"2024-01-19T04:32:12.944785+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T04:32:12.944785+0000","last_undegraded":"2024-01-19T04:32:12.944785+0000","last_fullsized":"2024-01-19T04:32:12.944785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979498+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:31:40.979498+0000","last_peered":"2024-01-19T04:31:40.979498+0000","last_clean":"2024-01-19T04:31:40.979498+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:31:40.979498+0000","last_undegraded":"2024-01-19T04:31:40.979498+0000","last_fullsized":"2024-01-19T04:31:40.979498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.221624+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T04:31:42.221624+0000","last_peered":"2024-01-19T04:31:42.221624+0000","last_clean":"2024-01-19T04:31:42.221624+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T04:31:42.221624+0000","last_undegraded":"2024-01-19T04:31:42.221624+0000","last_fullsized":"2024-01-19T04:31:42.221624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978524+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T04:31:40.978524+0000","last_peered":"2024-01-19T04:31:40.978524+0000","last_clean":"2024-01-19T04:31:40.978524+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T04:31:40.978524+0000","last_undegraded":"2024-01-19T04:31:40.978524+0000","last_fullsized":"2024-01-19T04:31:40.978524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.810829+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T04:31:39.810829+0000","last_peered":"2024-01-19T04:31:39.810829+0000","last_clean":"2024-01-19T04:31:39.810829+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T04:31:39.810829+0000","last_undegraded":"2024-01-19T04:31:39.810829+0000","last_fullsized":"2024-01-19T04:31:39.810829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216922+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T04:31:42.216922+0000","last_peered":"2024-01-19T04:31:42.216922+0000","last_clean":"2024-01-19T04:31:42.216922+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T04:31:42.216922+0000","last_undegraded":"2024-01-19T04:31:42.216922+0000","last_fullsized":"2024-01-19T04:31:42.216922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667067+0000","last_change":"2024-01-19T04:31:34.736261+0000","last_active":"2024-01-19T04:31:39.667067+0000","last_peered":"2024-01-19T04:31:39.667067+0000","last_clean":"2024-01-19T04:31:39.667067+0000","last_became_active":"2024-01-19T04:31:34.735525+0000","last_became_peered":"2024-01-19T04:31:34.735525+0000","last_unstale":"2024-01-19T04:31:39.667067+0000","last_undegraded":"2024-01-19T04:31:39.667067+0000","last_fullsized":"2024-01-19T04:31:39.667067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:41.517467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822263+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T04:31:39.822263+0000","last_peered":"2024-01-19T04:31:39.822263+0000","last_clean":"2024-01-19T04:31:39.822263+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T04:31:39.822263+0000","last_undegraded":"2024-01-19T04:31:39.822263+0000","last_fullsized":"2024-01-19T04:31:39.822263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216080+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T04:31:42.216080+0000","last_peered":"2024-01-19T04:31:42.216080+0000","last_clean":"2024-01-19T04:31:42.216080+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T04:31:42.216080+0000","last_undegraded":"2024-01-19T04:31:42.216080+0000","last_fullsized":"2024-01-19T04:31:42.216080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979841+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T04:31:40.979841+0000","last_peered":"2024-01-19T04:31:40.979841+0000","last_clean":"2024-01-19T04:31:40.979841+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T04:31:40.979841+0000","last_undegraded":"2024-01-19T04:31:40.979841+0000","last_fullsized":"2024-01-19T04:31:40.979841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813374+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T04:31:39.813374+0000","last_peered":"2024-01-19T04:31:39.813374+0000","last_clean":"2024-01-19T04:31:39.813374+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T04:31:39.813374+0000","last_undegraded":"2024-01-19T04:31:39.813374+0000","last_fullsized":"2024-01-19T04:31:39.813374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217615+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T04:31:42.217615+0000","last_peered":"2024-01-19T04:31:42.217615+0000","last_clean":"2024-01-19T04:31:42.217615+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T04:31:42.217615+0000","last_undegraded":"2024-01-19T04:31:42.217615+0000","last_fullsized":"2024-01-19T04:31:42.217615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979462+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T04:31:40.979462+0000","last_peered":"2024-01-19T04:31:40.979462+0000","last_clean":"2024-01-19T04:31:40.979462+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T04:31:40.979462+0000","last_undegraded":"2024-01-19T04:31:40.979462+0000","last_fullsized":"2024-01-19T04:31:40.979462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104895+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T04:31:41.104895+0000","last_peered":"2024-01-19T04:31:41.104895+0000","last_clean":"2024-01-19T04:31:41.104895+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T04:31:41.104895+0000","last_undegraded":"2024-01-19T04:31:41.104895+0000","last_fullsized":"2024-01-19T04:31:41.104895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217971+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T04:31:42.217971+0000","last_peered":"2024-01-19T04:31:42.217971+0000","last_clean":"2024-01-19T04:31:42.217971+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T04:31:42.217971+0000","last_undegraded":"2024-01-19T04:31:42.217971+0000","last_fullsized":"2024-01-19T04:31:42.217971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978224+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T04:31:40.978224+0000","last_peered":"2024-01-19T04:31:40.978224+0000","last_clean":"2024-01-19T04:31:40.978224+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T04:31:40.978224+0000","last_undegraded":"2024-01-19T04:31:40.978224+0000","last_fullsized":"2024-01-19T04:31:40.978224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'10","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.949549+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T04:32:12.949549+0000","last_peered":"2024-01-19T04:32:12.949549+0000","last_clean":"2024-01-19T04:32:12.949549+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T04:32:12.949549+0000","last_undegraded":"2024-01-19T04:32:12.949549+0000","last_fullsized":"2024-01-19T04:32:12.949549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216542+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T04:31:42.216542+0000","last_peered":"2024-01-19T04:31:42.216542+0000","last_clean":"2024-01-19T04:31:42.216542+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T04:31:42.216542+0000","last_undegraded":"2024-01-19T04:31:42.216542+0000","last_fullsized":"2024-01-19T04:31:42.216542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008763+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T04:31:41.008763+0000","last_peered":"2024-01-19T04:31:41.008763+0000","last_clean":"2024-01-19T04:31:41.008763+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T04:31:41.008763+0000","last_undegraded":"2024-01-19T04:31:41.008763+0000","last_fullsized":"2024-01-19T04:31:41.008763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008759+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T04:31:41.008759+0000","last_peered":"2024-01-19T04:31:41.008759+0000","last_clean":"2024-01-19T04:31:41.008759+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T04:31:41.008759+0000","last_undegraded":"2024-01-19T04:31:41.008759+0000","last_fullsized":"2024-01-19T04:31:41.008759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.648374+0000","last_change":"2024-01-19T04:31:39.841628+0000","last_active":"2024-01-19T04:31:41.648374+0000","last_peered":"2024-01-19T04:31:41.648374+0000","last_clean":"2024-01-19T04:31:41.648374+0000","last_became_active":"2024-01-19T04:31:39.841239+0000","last_became_peered":"2024-01-19T04:31:39.841239+0000","last_unstale":"2024-01-19T04:31:41.648374+0000","last_undegraded":"2024-01-19T04:31:41.648374+0000","last_fullsized":"2024-01-19T04:31:41.648374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:26:24.623871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978985+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T04:31:40.978985+0000","last_peered":"2024-01-19T04:31:40.978985+0000","last_clean":"2024-01-19T04:31:40.978985+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T04:31:40.978985+0000","last_undegraded":"2024-01-19T04:31:40.978985+0000","last_fullsized":"2024-01-19T04:31:40.978985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.943944+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T04:32:12.943944+0000","last_peered":"2024-01-19T04:32:12.943944+0000","last_clean":"2024-01-19T04:32:12.943944+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T04:32:12.943944+0000","last_undegraded":"2024-01-19T04:32:12.943944+0000","last_fullsized":"2024-01-19T04:32:12.943944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647710+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T04:31:41.647710+0000","last_peered":"2024-01-19T04:31:41.647710+0000","last_clean":"2024-01-19T04:31:41.647710+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T04:31:41.647710+0000","last_undegraded":"2024-01-19T04:31:41.647710+0000","last_fullsized":"2024-01-19T04:31:41.647710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724950+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T04:31:39.724950+0000","last_peered":"2024-01-19T04:31:39.724950+0000","last_clean":"2024-01-19T04:31:39.724950+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T04:31:39.724950+0000","last_undegraded":"2024-01-19T04:31:39.724950+0000","last_fullsized":"2024-01-19T04:31:39.724950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725821+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T04:31:39.725821+0000","last_peered":"2024-01-19T04:31:39.725821+0000","last_clean":"2024-01-19T04:31:39.725821+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T04:31:39.725821+0000","last_undegraded":"2024-01-19T04:31:39.725821+0000","last_fullsized":"2024-01-19T04:31:39.725821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222496+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T04:31:42.222496+0000","last_peered":"2024-01-19T04:31:42.222496+0000","last_clean":"2024-01-19T04:31:42.222496+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T04:31:42.222496+0000","last_undegraded":"2024-01-19T04:31:42.222496+0000","last_fullsized":"2024-01-19T04:31:42.222496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978551+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T04:31:40.978551+0000","last_peered":"2024-01-19T04:31:40.978551+0000","last_clean":"2024-01-19T04:31:40.978551+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T04:31:40.978551+0000","last_undegraded":"2024-01-19T04:31:40.978551+0000","last_fullsized":"2024-01-19T04:31:40.978551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.933754+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T04:32:12.933754+0000","last_peered":"2024-01-19T04:32:12.933754+0000","last_clean":"2024-01-19T04:32:12.933754+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T04:32:12.933754+0000","last_undegraded":"2024-01-19T04:32:12.933754+0000","last_fullsized":"2024-01-19T04:32:12.933754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285152+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T04:31:41.285152+0000","last_peered":"2024-01-19T04:31:41.285152+0000","last_clean":"2024-01-19T04:31:41.285152+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T04:31:41.285152+0000","last_undegraded":"2024-01-19T04:31:41.285152+0000","last_fullsized":"2024-01-19T04:31:41.285152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104147+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T04:31:41.104147+0000","last_peered":"2024-01-19T04:31:41.104147+0000","last_clean":"2024-01-19T04:31:41.104147+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T04:31:41.104147+0000","last_undegraded":"2024-01-19T04:31:41.104147+0000","last_fullsized":"2024-01-19T04:31:41.104147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285986+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T04:31:41.285986+0000","last_peered":"2024-01-19T04:31:41.285986+0000","last_clean":"2024-01-19T04:31:41.285986+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T04:31:41.285986+0000","last_undegraded":"2024-01-19T04:31:41.285986+0000","last_fullsized":"2024-01-19T04:31:41.285986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223324+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T04:31:42.223324+0000","last_peered":"2024-01-19T04:31:42.223324+0000","last_clean":"2024-01-19T04:31:42.223324+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T04:31:42.223324+0000","last_undegraded":"2024-01-19T04:31:42.223324+0000","last_fullsized":"2024-01-19T04:31:42.223324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726771+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T04:31:39.726771+0000","last_peered":"2024-01-19T04:31:39.726771+0000","last_clean":"2024-01-19T04:31:39.726771+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T04:31:39.726771+0000","last_undegraded":"2024-01-19T04:31:39.726771+0000","last_fullsized":"2024-01-19T04:31:39.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.941821+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T04:32:12.941821+0000","last_peered":"2024-01-19T04:32:12.941821+0000","last_clean":"2024-01-19T04:32:12.941821+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T04:32:12.941821+0000","last_undegraded":"2024-01-19T04:32:12.941821+0000","last_fullsized":"2024-01-19T04:32:12.941821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646384+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T04:31:41.646384+0000","last_peered":"2024-01-19T04:31:41.646384+0000","last_clean":"2024-01-19T04:31:41.646384+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T04:31:41.646384+0000","last_undegraded":"2024-01-19T04:31:41.646384+0000","last_fullsized":"2024-01-19T04:31:41.646384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668228+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T04:31:39.668228+0000","last_peered":"2024-01-19T04:31:39.668228+0000","last_clean":"2024-01-19T04:31:39.668228+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T04:31:39.668228+0000","last_undegraded":"2024-01-19T04:31:39.668228+0000","last_fullsized":"2024-01-19T04:31:39.668228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934809+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T04:32:12.934809+0000","last_peered":"2024-01-19T04:32:12.934809+0000","last_clean":"2024-01-19T04:32:12.934809+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T04:32:12.934809+0000","last_undegraded":"2024-01-19T04:32:12.934809+0000","last_fullsized":"2024-01-19T04:32:12.934809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646461+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T04:31:41.646461+0000","last_peered":"2024-01-19T04:31:41.646461+0000","last_clean":"2024-01-19T04:31:41.646461+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T04:31:41.646461+0000","last_undegraded":"2024-01-19T04:31:41.646461+0000","last_fullsized":"2024-01-19T04:31:41.646461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216448+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T04:31:42.216448+0000","last_peered":"2024-01-19T04:31:42.216448+0000","last_clean":"2024-01-19T04:31:42.216448+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T04:31:42.216448+0000","last_undegraded":"2024-01-19T04:31:42.216448+0000","last_fullsized":"2024-01-19T04:31:42.216448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820389+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T04:31:39.820389+0000","last_peered":"2024-01-19T04:31:39.820389+0000","last_clean":"2024-01-19T04:31:39.820389+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T04:31:39.820389+0000","last_undegraded":"2024-01-19T04:31:39.820389+0000","last_fullsized":"2024-01-19T04:31:39.820389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218875+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T04:31:42.218875+0000","last_peered":"2024-01-19T04:31:42.218875+0000","last_clean":"2024-01-19T04:31:42.218875+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T04:31:42.218875+0000","last_undegraded":"2024-01-19T04:31:42.218875+0000","last_fullsized":"2024-01-19T04:31:42.218875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222235+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T04:31:42.222235+0000","last_peered":"2024-01-19T04:31:42.222235+0000","last_clean":"2024-01-19T04:31:42.222235+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T04:31:42.222235+0000","last_undegraded":"2024-01-19T04:31:42.222235+0000","last_fullsized":"2024-01-19T04:31:42.222235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813740+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T04:31:39.813740+0000","last_peered":"2024-01-19T04:31:39.813740+0000","last_clean":"2024-01-19T04:31:39.813740+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T04:31:39.813740+0000","last_undegraded":"2024-01-19T04:31:39.813740+0000","last_fullsized":"2024-01-19T04:31:39.813740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817749+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T04:31:39.817749+0000","last_peered":"2024-01-19T04:31:39.817749+0000","last_clean":"2024-01-19T04:31:39.817749+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T04:31:39.817749+0000","last_undegraded":"2024-01-19T04:31:39.817749+0000","last_fullsized":"2024-01-19T04:31:39.817749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.011146+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T04:31:41.011146+0000","last_peered":"2024-01-19T04:31:41.011146+0000","last_clean":"2024-01-19T04:31:41.011146+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T04:31:41.011146+0000","last_undegraded":"2024-01-19T04:31:41.011146+0000","last_fullsized":"2024-01-19T04:31:41.011146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725708+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T04:31:39.725708+0000","last_peered":"2024-01-19T04:31:39.725708+0000","last_clean":"2024-01-19T04:31:39.725708+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T04:31:39.725708+0000","last_undegraded":"2024-01-19T04:31:39.725708+0000","last_fullsized":"2024-01-19T04:31:39.725708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275109+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T04:31:41.275109+0000","last_peered":"2024-01-19T04:31:41.275109+0000","last_clean":"2024-01-19T04:31:41.275109+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T04:31:41.275109+0000","last_undegraded":"2024-01-19T04:31:41.275109+0000","last_fullsized":"2024-01-19T04:31:41.275109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.064237+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T04:32:13.064237+0000","last_peered":"2024-01-19T04:32:13.064237+0000","last_clean":"2024-01-19T04:32:13.064237+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T04:32:13.064237+0000","last_undegraded":"2024-01-19T04:32:13.064237+0000","last_fullsized":"2024-01-19T04:32:13.064237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103673+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T04:31:41.103673+0000","last_peered":"2024-01-19T04:31:41.103673+0000","last_clean":"2024-01-19T04:31:41.103673+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T04:31:41.103673+0000","last_undegraded":"2024-01-19T04:31:41.103673+0000","last_fullsized":"2024-01-19T04:31:41.103673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647676+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T04:31:41.647676+0000","last_peered":"2024-01-19T04:31:41.647676+0000","last_clean":"2024-01-19T04:31:41.647676+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T04:31:41.647676+0000","last_undegraded":"2024-01-19T04:31:41.647676+0000","last_fullsized":"2024-01-19T04:31:41.647676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008510+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T04:31:41.008510+0000","last_peered":"2024-01-19T04:31:41.008510+0000","last_clean":"2024-01-19T04:31:41.008510+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T04:31:41.008510+0000","last_undegraded":"2024-01-19T04:31:41.008510+0000","last_fullsized":"2024-01-19T04:31:41.008510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.812464+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T04:31:39.812464+0000","last_peered":"2024-01-19T04:31:39.812464+0000","last_clean":"2024-01-19T04:31:39.812464+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T04:31:39.812464+0000","last_undegraded":"2024-01-19T04:31:39.812464+0000","last_fullsized":"2024-01-19T04:31:39.812464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666159+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T04:31:39.666159+0000","last_peered":"2024-01-19T04:31:39.666159+0000","last_clean":"2024-01-19T04:31:39.666159+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T04:31:39.666159+0000","last_undegraded":"2024-01-19T04:31:39.666159+0000","last_fullsized":"2024-01-19T04:31:39.666159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725587+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T04:31:39.725587+0000","last_peered":"2024-01-19T04:31:39.725587+0000","last_clean":"2024-01-19T04:31:39.725587+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T04:31:39.725587+0000","last_undegraded":"2024-01-19T04:31:39.725587+0000","last_fullsized":"2024-01-19T04:31:39.725587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821683+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T04:31:39.821683+0000","last_peered":"2024-01-19T04:31:39.821683+0000","last_clean":"2024-01-19T04:31:39.821683+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T04:31:39.821683+0000","last_undegraded":"2024-01-19T04:31:39.821683+0000","last_fullsized":"2024-01-19T04:31:39.821683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822108+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T04:31:39.822108+0000","last_peered":"2024-01-19T04:31:39.822108+0000","last_clean":"2024-01-19T04:31:39.822108+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T04:31:39.822108+0000","last_undegraded":"2024-01-19T04:31:39.822108+0000","last_fullsized":"2024-01-19T04:31:39.822108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009546+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T04:31:41.009546+0000","last_peered":"2024-01-19T04:31:41.009546+0000","last_clean":"2024-01-19T04:31:41.009546+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T04:31:41.009546+0000","last_undegraded":"2024-01-19T04:31:41.009546+0000","last_fullsized":"2024-01-19T04:31:41.009546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821774+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T04:31:39.821774+0000","last_peered":"2024-01-19T04:31:39.821774+0000","last_clean":"2024-01-19T04:31:39.821774+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T04:31:39.821774+0000","last_undegraded":"2024-01-19T04:31:39.821774+0000","last_fullsized":"2024-01-19T04:31:39.821774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666053+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T04:31:39.666053+0000","last_peered":"2024-01-19T04:31:39.666053+0000","last_clean":"2024-01-19T04:31:39.666053+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T04:31:39.666053+0000","last_undegraded":"2024-01-19T04:31:39.666053+0000","last_fullsized":"2024-01-19T04:31:39.666053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817657+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T04:31:39.817657+0000","last_peered":"2024-01-19T04:31:39.817657+0000","last_clean":"2024-01-19T04:31:39.817657+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T04:31:39.817657+0000","last_undegraded":"2024-01-19T04:31:39.817657+0000","last_fullsized":"2024-01-19T04:31:39.817657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665952+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T04:31:39.665952+0000","last_peered":"2024-01-19T04:31:39.665952+0000","last_clean":"2024-01-19T04:31:39.665952+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T04:31:39.665952+0000","last_undegraded":"2024-01-19T04:31:39.665952+0000","last_fullsized":"2024-01-19T04:31:39.665952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725169+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T04:31:39.725169+0000","last_peered":"2024-01-19T04:31:39.725169+0000","last_clean":"2024-01-19T04:31:39.725169+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T04:31:39.725169+0000","last_undegraded":"2024-01-19T04:31:39.725169+0000","last_fullsized":"2024-01-19T04:31:39.725169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008993+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T04:31:41.008993+0000","last_peered":"2024-01-19T04:31:41.008993+0000","last_clean":"2024-01-19T04:31:41.008993+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T04:31:41.008993+0000","last_undegraded":"2024-01-19T04:31:41.008993+0000","last_fullsized":"2024-01-19T04:31:41.008993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979162+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T04:31:40.979162+0000","last_peered":"2024-01-19T04:31:40.979162+0000","last_clean":"2024-01-19T04:31:40.979162+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T04:31:40.979162+0000","last_undegraded":"2024-01-19T04:31:40.979162+0000","last_fullsized":"2024-01-19T04:31:40.979162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813279+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T04:31:39.813279+0000","last_peered":"2024-01-19T04:31:39.813279+0000","last_clean":"2024-01-19T04:31:39.813279+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T04:31:39.813279+0000","last_undegraded":"2024-01-19T04:31:39.813279+0000","last_fullsized":"2024-01-19T04:31:39.813279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668465+0000","last_change":"2024-01-19T04:31:34.743868+0000","last_active":"2024-01-19T04:31:39.668465+0000","last_peered":"2024-01-19T04:31:39.668465+0000","last_clean":"2024-01-19T04:31:39.668465+0000","last_became_active":"2024-01-19T04:31:34.743503+0000","last_became_peered":"2024-01-19T04:31:34.743503+0000","last_unstale":"2024-01-19T04:31:39.668465+0000","last_undegraded":"2024-01-19T04:31:39.668465+0000","last_fullsized":"2024-01-19T04:31:39.668465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:22.598439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665835+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T04:31:39.665835+0000","last_peered":"2024-01-19T04:31:39.665835+0000","last_clean":"2024-01-19T04:31:39.665835+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T04:31:39.665835+0000","last_undegraded":"2024-01-19T04:31:39.665835+0000","last_fullsized":"2024-01-19T04:31:39.665835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820435+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T04:31:39.820435+0000","last_peered":"2024-01-19T04:31:39.820435+0000","last_clean":"2024-01-19T04:31:39.820435+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T04:31:39.820435+0000","last_undegraded":"2024-01-19T04:31:39.820435+0000","last_fullsized":"2024-01-19T04:31:39.820435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724966+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T04:31:39.724966+0000","last_peered":"2024-01-19T04:31:39.724966+0000","last_clean":"2024-01-19T04:31:39.724966+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T04:31:39.724966+0000","last_undegraded":"2024-01-19T04:31:39.724966+0000","last_fullsized":"2024-01-19T04:31:39.724966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817772+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T04:31:39.817772+0000","last_peered":"2024-01-19T04:31:39.817772+0000","last_clean":"2024-01-19T04:31:39.817772+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T04:31:39.817772+0000","last_undegraded":"2024-01-19T04:31:39.817772+0000","last_fullsized":"2024-01-19T04:31:39.817772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104062+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T04:31:41.104062+0000","last_peered":"2024-01-19T04:31:41.104062+0000","last_clean":"2024-01-19T04:31:41.104062+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T04:31:41.104062+0000","last_undegraded":"2024-01-19T04:31:41.104062+0000","last_fullsized":"2024-01-19T04:31:41.104062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009588+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T04:31:41.009588+0000","last_peered":"2024-01-19T04:31:41.009588+0000","last_clean":"2024-01-19T04:31:41.009588+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T04:31:41.009588+0000","last_undegraded":"2024-01-19T04:31:41.009588+0000","last_fullsized":"2024-01-19T04:31:41.009588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009336+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T04:31:41.009336+0000","last_peered":"2024-01-19T04:31:41.009336+0000","last_clean":"2024-01-19T04:31:41.009336+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T04:31:41.009336+0000","last_undegraded":"2024-01-19T04:31:41.009336+0000","last_fullsized":"2024-01-19T04:31:41.009336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979732+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T04:31:40.979732+0000","last_peered":"2024-01-19T04:31:40.979732+0000","last_clean":"2024-01-19T04:31:40.979732+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T04:31:40.979732+0000","last_undegraded":"2024-01-19T04:31:40.979732+0000","last_fullsized":"2024-01-19T04:31:40.979732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.809480+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T04:31:39.809480+0000","last_peered":"2024-01-19T04:31:39.809480+0000","last_clean":"2024-01-19T04:31:39.809480+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T04:31:39.809480+0000","last_undegraded":"2024-01-19T04:31:39.809480+0000","last_fullsized":"2024-01-19T04:31:39.809480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978084+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T04:31:40.978084+0000","last_peered":"2024-01-19T04:31:40.978084+0000","last_clean":"2024-01-19T04:31:40.978084+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T04:31:40.978084+0000","last_undegraded":"2024-01-19T04:31:40.978084+0000","last_fullsized":"2024-01-19T04:31:40.978084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665994+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T04:31:39.665994+0000","last_peered":"2024-01-19T04:31:39.665994+0000","last_clean":"2024-01-19T04:31:39.665994+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T04:31:39.665994+0000","last_undegraded":"2024-01-19T04:31:39.665994+0000","last_fullsized":"2024-01-19T04:31:39.665994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978264+0000","last_change":"2024-01-19T04:31:33.071431+0000","last_active":"2024-01-19T04:31:40.978264+0000","last_peered":"2024-01-19T04:31:40.978264+0000","last_clean":"2024-01-19T04:31:40.978264+0000","last_became_active":"2024-01-19T04:31:33.070826+0000","last_became_peered":"2024-01-19T04:31:33.070826+0000","last_unstale":"2024-01-19T04:31:40.978264+0000","last_undegraded":"2024-01-19T04:31:40.978264+0000","last_fullsized":"2024-01-19T04:31:40.978264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:36:31.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666838+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T04:31:39.666838+0000","last_peered":"2024-01-19T04:31:39.666838+0000","last_clean":"2024-01-19T04:31:39.666838+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T04:31:39.666838+0000","last_undegraded":"2024-01-19T04:31:39.666838+0000","last_fullsized":"2024-01-19T04:31:39.666838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724952+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T04:31:39.724952+0000","last_peered":"2024-01-19T04:31:39.724952+0000","last_clean":"2024-01-19T04:31:39.724952+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T04:31:39.724952+0000","last_undegraded":"2024-01-19T04:31:39.724952+0000","last_fullsized":"2024-01-19T04:31:39.724952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822589+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T04:31:39.822589+0000","last_peered":"2024-01-19T04:31:39.822589+0000","last_clean":"2024-01-19T04:31:39.822589+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T04:31:39.822589+0000","last_undegraded":"2024-01-19T04:31:39.822589+0000","last_fullsized":"2024-01-19T04:31:39.822589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979575+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T04:31:40.979575+0000","last_peered":"2024-01-19T04:31:40.979575+0000","last_clean":"2024-01-19T04:31:40.979575+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T04:31:40.979575+0000","last_undegraded":"2024-01-19T04:31:40.979575+0000","last_fullsized":"2024-01-19T04:31:40.979575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6023,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":11334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.03},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.0649999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476758,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":119306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.503}]},{"osd":2,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.877}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.075},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.1379999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.171}]}]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":122405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.7309999999999999,"5min":5.7309999999999999,"15min":5.7309999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7850000000000001,"5min":5.7850000000000001,"15min":5.7850000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0140000000000002,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.622},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.125}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":1.161},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":5.6920000000000002,"5min":5.6920000000000002,"15min":5.6920000000000002},"last":1.05}]}]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":119236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.04}]},{"osd":1,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.103},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.014},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.1819999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.125},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.208}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":118600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.63400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.746}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.1950000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.997}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.04},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.403}]}]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.503}]},{"osd":1,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.873}]},{"osd":7,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0369999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":892928,"data_stored":709424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.87},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.1379999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.234},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.113}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.214}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0720000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":709480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68999999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.877},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.153}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.228},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.024}]},{"osd":7,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.2030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:32:16.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:32:16.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.865+0000 7ff8ba331640 1 Processor -- start 2024-01-19T04:32:16.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.865+0000 7ff8ba331640 1 -- start start 2024-01-19T04:32:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.865+0000 7ff8ba331640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b414fa50 0x7ff8b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.865+0000 7ff8ba331640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b4072ce0 con 0x7ff8b4159af0 2024-01-19T04:32:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.865+0000 7ff8ba331640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40c05f0 con 0x7ff8b40715f0 2024-01-19T04:32:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.865+0000 7ff8ba331640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b4155a30 con 0x7ff8b414fa50 2024-01-19T04:32:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.869+0000 7ff8b3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b414fa50 0x7ff8b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.869+0000 7ff8b88ce640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8b4159af0 0x7ff8b40c7790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39372/0 (socket says 172.21.15.133:39372) 2024-01-19T04:32:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.869+0000 7ff8b88ce640 1 -- 172.21.15.133:0/818048946 learned_addr learned my addr 172.21.15.133:0/818048946 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:16.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.873+0000 7ff8b3fff640 1 -- 172.21.15.133:0/818048946 >> v1:172.21.15.156:6789/0 conn(0x7ff8b40715f0 legacy=0x7ff8b41593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:16.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.873+0000 7ff8b3fff640 1 -- 172.21.15.133:0/818048946 >> v1:172.21.15.133:6789/0 conn(0x7ff8b4159af0 legacy=0x7ff8b40c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.873+0000 7ff8b3fff640 1 -- 172.21.15.133:0/818048946 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b4155c40 con 0x7ff8b414fa50 2024-01-19T04:32:16.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.877+0000 7ff8b3fff640 1 --2- 172.21.15.133:0/818048946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b414fa50 0x7ff8b40710b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097c0 tx=0x7ff8a401fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6957b0e152ddf856 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:16.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.881+0000 7ff8b37fe640 1 -- 172.21.15.133:0/818048946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40a9c70 con 0x7ff8b414fa50 2024-01-19T04:32:16.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.881+0000 7ff8b37fe640 1 -- 172.21.15.133:0/818048946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a40a9dd0 con 0x7ff8b414fa50 2024-01-19T04:32:16.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.881+0000 7ff8b37fe640 1 -- 172.21.15.133:0/818048946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40b1660 con 0x7ff8b414fa50 2024-01-19T04:32:16.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- 172.21.15.133:0/818048946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b414fa50 msgr2=0x7ff8b40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 --2- 172.21.15.133:0/818048946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b414fa50 0x7ff8b40710b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097c0 tx=0x7ff8a401fe60 comp rx=0 tx=0).stop 2024-01-19T04:32:16.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- 172.21.15.133:0/818048946 shutdown_connections 2024-01-19T04:32:16.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 --2- 172.21.15.133:0/818048946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b414fa50 0x7ff8b40710b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- 172.21.15.133:0/818048946 >> 172.21.15.133:0/818048946 conn(0x7ff8b406d590 msgr2=0x7ff8b4066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:16.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- 172.21.15.133:0/818048946 shutdown_connections 2024-01-19T04:32:16.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- 172.21.15.133:0/818048946 wait complete. 2024-01-19T04:32:16.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 Processor -- start 2024-01-19T04:32:16.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- start start 2024-01-19T04:32:16.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 0x7ff8b4157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b414fa50 0x7ff8b41435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8b4159af0 0x7ff8b41eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4141380 con 0x7ff8b40715f0 2024-01-19T04:32:16.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4140d70 con 0x7ff8b414fa50 2024-01-19T04:32:16.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8ba331640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b414c0b0 con 0x7ff8b4159af0 2024-01-19T04:32:16.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 0x7ff8b4157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 0x7ff8b4157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56284/0 (socket says 172.21.15.133:56284) 2024-01-19T04:32:16.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.885+0000 7ff8b3fff640 1 -- 172.21.15.133:0/4037280874 learned_addr learned my addr 172.21.15.133:0/4037280874 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:16.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.889+0000 7ff8b88ce640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8b4159af0 0x7ff8b41eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.889+0000 7ff8b3fff640 1 -- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8b4159af0 msgr2=0x7ff8b41eebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.889+0000 7ff8b3fff640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8b4159af0 0x7ff8b41eebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.889+0000 7ff8b3fff640 1 -- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b414fa50 msgr2=0x7ff8b41435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:16.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.889+0000 7ff8b3fff640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b414fa50 0x7ff8b41435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:16.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.889+0000 7ff8b3fff640 1 -- 172.21.15.133:0/4037280874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4009420 con 0x7ff8b40715f0 2024-01-19T04:32:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.893+0000 7ff8b3fff640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 0x7ff8b4157600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097c0 tx=0x7ff8a401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.901+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40b1da0 con 0x7ff8b40715f0 2024-01-19T04:32:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.901+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400c050 con 0x7ff8b40715f0 2024-01-19T04:32:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.901+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b4141010 con 0x7ff8b40715f0 2024-01-19T04:32:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.901+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40ba670 con 0x7ff8b40715f0 2024-01-19T04:32:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.901+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b414c390 con 0x7ff8b40715f0 2024-01-19T04:32:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.901+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b41eea40 con 0x7ff8b40715f0 2024-01-19T04:32:16.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.925+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff8a40b8040 con 0x7ff8b40715f0 2024-01-19T04:32:16.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.925+0000 7ff8b17fa640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff894066550 0x7ff894068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:16.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.925+0000 7ff8abfff640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff894066550 0x7ff894068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:16.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.925+0000 7ff8abfff640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff894066550 0x7ff894068a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff89c007fd0 tx=0x7ff89c0079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:16.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:16.929+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff8a40f3ef0 con 0x7ff8b40715f0 2024-01-19T04:32:17.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.225+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff8a40efb30 con 0x7ff8b40715f0 2024-01-19T04:32:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.393+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8b41564e0 con 0x7ff894066550 2024-01-19T04:32:17.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.421+0000 7ff8b17fa640 1 -- 172.21.15.133:0/4037280874 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368587 (secure 0 0 0) 0x7ff89c0050d0 con 0x7ff894066550 2024-01-19T04:32:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:17.430 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T04:32:17.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff894066550 msgr2=0x7ff894068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:17.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff894066550 0x7ff894068a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff89c007fd0 tx=0x7ff89c0079a0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 msgr2=0x7ff8b4157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:17.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 0x7ff8b4157600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097c0 tx=0x7ff8a401cc00 comp rx=0 tx=0).stop 2024-01-19T04:32:17.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 shutdown_connections 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff894066550 0x7ff894068a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b414fa50 0x7ff8b41435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8b4159af0 0x7ff8b41eebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 --2- 172.21.15.133:0/4037280874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40715f0 0x7ff8b4157600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 >> 172.21.15.133:0/4037280874 conn(0x7ff8b406d590 msgr2=0x7ff8b40c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 shutdown_connections 2024-01-19T04:32:17.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.429+0000 7ff8ba331640 1 -- 172.21.15.133:0/4037280874 wait complete. 2024-01-19T04:32:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-01-19T04:32:15.618235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596391,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240496,"kb_used_data":3556,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734224,"statfs":{"total":773094113280,"available":772847845376,"internally_reserved":0,"allocated":3641344,"data_stored":2139862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1525,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005241"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726836+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T04:31:39.726836+0000","last_peered":"2024-01-19T04:31:39.726836+0000","last_clean":"2024-01-19T04:31:39.726836+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T04:31:39.726836+0000","last_undegraded":"2024-01-19T04:31:39.726836+0000","last_fullsized":"2024-01-19T04:31:39.726836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821877+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T04:31:39.821877+0000","last_peered":"2024-01-19T04:31:39.821877+0000","last_clean":"2024-01-19T04:31:39.821877+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T04:31:39.821877+0000","last_undegraded":"2024-01-19T04:31:39.821877+0000","last_fullsized":"2024-01-19T04:31:39.821877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646153+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T04:31:41.646153+0000","last_peered":"2024-01-19T04:31:41.646153+0000","last_clean":"2024-01-19T04:31:41.646153+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T04:31:41.646153+0000","last_undegraded":"2024-01-19T04:31:41.646153+0000","last_fullsized":"2024-01-19T04:31:41.646153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822053+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T04:31:39.822053+0000","last_peered":"2024-01-19T04:31:39.822053+0000","last_clean":"2024-01-19T04:31:39.822053+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T04:31:39.822053+0000","last_undegraded":"2024-01-19T04:31:39.822053+0000","last_fullsized":"2024-01-19T04:31:39.822053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726714+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T04:31:39.726714+0000","last_peered":"2024-01-19T04:31:39.726714+0000","last_clean":"2024-01-19T04:31:39.726714+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T04:31:39.726714+0000","last_undegraded":"2024-01-19T04:31:39.726714+0000","last_fullsized":"2024-01-19T04:31:39.726714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217797+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T04:31:42.217797+0000","last_peered":"2024-01-19T04:31:42.217797+0000","last_clean":"2024-01-19T04:31:42.217797+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T04:31:42.217797+0000","last_undegraded":"2024-01-19T04:31:42.217797+0000","last_fullsized":"2024-01-19T04:31:42.217797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979117+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T04:31:40.979117+0000","last_peered":"2024-01-19T04:31:40.979117+0000","last_clean":"2024-01-19T04:31:40.979117+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T04:31:40.979117+0000","last_undegraded":"2024-01-19T04:31:40.979117+0000","last_fullsized":"2024-01-19T04:31:40.979117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667121+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T04:31:39.667121+0000","last_peered":"2024-01-19T04:31:39.667121+0000","last_clean":"2024-01-19T04:31:39.667121+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T04:31:39.667121+0000","last_undegraded":"2024-01-19T04:31:39.667121+0000","last_fullsized":"2024-01-19T04:31:39.667121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223120+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T04:31:42.223120+0000","last_peered":"2024-01-19T04:31:42.223120+0000","last_clean":"2024-01-19T04:31:42.223120+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T04:31:42.223120+0000","last_undegraded":"2024-01-19T04:31:42.223120+0000","last_fullsized":"2024-01-19T04:31:42.223120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978611+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T04:31:40.978611+0000","last_peered":"2024-01-19T04:31:40.978611+0000","last_clean":"2024-01-19T04:31:40.978611+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T04:31:40.978611+0000","last_undegraded":"2024-01-19T04:31:40.978611+0000","last_fullsized":"2024-01-19T04:31:40.978611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667803+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T04:31:39.667803+0000","last_peered":"2024-01-19T04:31:39.667803+0000","last_clean":"2024-01-19T04:31:39.667803+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T04:31:39.667803+0000","last_undegraded":"2024-01-19T04:31:39.667803+0000","last_fullsized":"2024-01-19T04:31:39.667803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218929+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T04:31:42.218929+0000","last_peered":"2024-01-19T04:31:42.218929+0000","last_clean":"2024-01-19T04:31:42.218929+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T04:31:42.218929+0000","last_undegraded":"2024-01-19T04:31:42.218929+0000","last_fullsized":"2024-01-19T04:31:42.218929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.010875+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T04:31:41.010875+0000","last_peered":"2024-01-19T04:31:41.010875+0000","last_clean":"2024-01-19T04:31:41.010875+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T04:31:41.010875+0000","last_undegraded":"2024-01-19T04:31:41.010875+0000","last_fullsized":"2024-01-19T04:31:41.010875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979488+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T04:31:40.979488+0000","last_peered":"2024-01-19T04:31:40.979488+0000","last_clean":"2024-01-19T04:31:40.979488+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T04:31:40.979488+0000","last_undegraded":"2024-01-19T04:31:40.979488+0000","last_fullsized":"2024-01-19T04:31:40.979488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222921+0000","last_change":"2024-01-19T04:31:39.820690+0000","last_active":"2024-01-19T04:31:42.222921+0000","last_peered":"2024-01-19T04:31:42.222921+0000","last_clean":"2024-01-19T04:31:42.222921+0000","last_became_active":"2024-01-19T04:31:39.820114+0000","last_became_peered":"2024-01-19T04:31:39.820114+0000","last_unstale":"2024-01-19T04:31:42.222921+0000","last_undegraded":"2024-01-19T04:31:42.222921+0000","last_fullsized":"2024-01-19T04:31:42.222921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817855+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T04:31:39.817855+0000","last_peered":"2024-01-19T04:31:39.817855+0000","last_clean":"2024-01-19T04:31:39.817855+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T04:31:39.817855+0000","last_undegraded":"2024-01-19T04:31:39.817855+0000","last_fullsized":"2024-01-19T04:31:39.817855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821707+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T04:31:39.821707+0000","last_peered":"2024-01-19T04:31:39.821707+0000","last_clean":"2024-01-19T04:31:39.821707+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T04:31:39.821707+0000","last_undegraded":"2024-01-19T04:31:39.821707+0000","last_fullsized":"2024-01-19T04:31:39.821707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.219094+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T04:31:42.219094+0000","last_peered":"2024-01-19T04:31:42.219094+0000","last_clean":"2024-01-19T04:31:42.219094+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T04:31:42.219094+0000","last_undegraded":"2024-01-19T04:31:42.219094+0000","last_fullsized":"2024-01-19T04:31:42.219094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813733+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T04:31:39.813733+0000","last_peered":"2024-01-19T04:31:39.813733+0000","last_clean":"2024-01-19T04:31:39.813733+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T04:31:39.813733+0000","last_undegraded":"2024-01-19T04:31:39.813733+0000","last_fullsized":"2024-01-19T04:31:39.813733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.070096+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T04:32:13.070096+0000","last_peered":"2024-01-19T04:32:13.070096+0000","last_clean":"2024-01-19T04:32:13.070096+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T04:32:13.070096+0000","last_undegraded":"2024-01-19T04:32:13.070096+0000","last_fullsized":"2024-01-19T04:32:13.070096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286153+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T04:31:41.286153+0000","last_peered":"2024-01-19T04:31:41.286153+0000","last_clean":"2024-01-19T04:31:41.286153+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T04:31:41.286153+0000","last_undegraded":"2024-01-19T04:31:41.286153+0000","last_fullsized":"2024-01-19T04:31:41.286153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103858+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T04:31:41.103858+0000","last_peered":"2024-01-19T04:31:41.103858+0000","last_clean":"2024-01-19T04:31:41.103858+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T04:31:41.103858+0000","last_undegraded":"2024-01-19T04:31:41.103858+0000","last_fullsized":"2024-01-19T04:31:41.103858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.977928+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T04:31:40.977928+0000","last_peered":"2024-01-19T04:31:40.977928+0000","last_clean":"2024-01-19T04:31:40.977928+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T04:31:40.977928+0000","last_undegraded":"2024-01-19T04:31:40.977928+0000","last_fullsized":"2024-01-19T04:31:40.977928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218706+0000","last_change":"2024-01-19T04:31:39.836900+0000","last_active":"2024-01-19T04:31:42.218706+0000","last_peered":"2024-01-19T04:31:42.218706+0000","last_clean":"2024-01-19T04:31:42.218706+0000","last_became_active":"2024-01-19T04:31:39.834989+0000","last_became_peered":"2024-01-19T04:31:39.834989+0000","last_unstale":"2024-01-19T04:31:42.218706+0000","last_undegraded":"2024-01-19T04:31:42.218706+0000","last_fullsized":"2024-01-19T04:31:42.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:18.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726309+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T04:31:39.726309+0000","last_peered":"2024-01-19T04:31:39.726309+0000","last_clean":"2024-01-19T04:31:39.726309+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T04:31:39.726309+0000","last_undegraded":"2024-01-19T04:31:39.726309+0000","last_fullsized":"2024-01-19T04:31:39.726309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934913+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T04:32:12.934913+0000","last_peered":"2024-01-19T04:32:12.934913+0000","last_clean":"2024-01-19T04:32:12.934913+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T04:32:12.934913+0000","last_undegraded":"2024-01-19T04:32:12.934913+0000","last_fullsized":"2024-01-19T04:32:12.934913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218365+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T04:31:42.218365+0000","last_peered":"2024-01-19T04:31:42.218365+0000","last_clean":"2024-01-19T04:31:42.218365+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T04:31:42.218365+0000","last_undegraded":"2024-01-19T04:31:42.218365+0000","last_fullsized":"2024-01-19T04:31:42.218365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821854+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T04:31:39.821854+0000","last_peered":"2024-01-19T04:31:39.821854+0000","last_clean":"2024-01-19T04:31:39.821854+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T04:31:39.821854+0000","last_undegraded":"2024-01-19T04:31:39.821854+0000","last_fullsized":"2024-01-19T04:31:39.821854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822760+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T04:31:39.822760+0000","last_peered":"2024-01-19T04:31:39.822760+0000","last_clean":"2024-01-19T04:31:39.822760+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T04:31:39.822760+0000","last_undegraded":"2024-01-19T04:31:39.822760+0000","last_fullsized":"2024-01-19T04:31:39.822760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.645798+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T04:31:41.645798+0000","last_peered":"2024-01-19T04:31:41.645798+0000","last_clean":"2024-01-19T04:31:41.645798+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T04:31:41.645798+0000","last_undegraded":"2024-01-19T04:31:41.645798+0000","last_fullsized":"2024-01-19T04:31:41.645798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821924+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T04:31:39.821924+0000","last_peered":"2024-01-19T04:31:39.821924+0000","last_clean":"2024-01-19T04:31:39.821924+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T04:31:39.821924+0000","last_undegraded":"2024-01-19T04:31:39.821924+0000","last_fullsized":"2024-01-19T04:31:39.821924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979346+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T04:31:40.979346+0000","last_peered":"2024-01-19T04:31:40.979346+0000","last_clean":"2024-01-19T04:31:40.979346+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T04:31:40.979346+0000","last_undegraded":"2024-01-19T04:31:40.979346+0000","last_fullsized":"2024-01-19T04:31:40.979346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.215923+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T04:31:42.215923+0000","last_peered":"2024-01-19T04:31:42.215923+0000","last_clean":"2024-01-19T04:31:42.215923+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T04:31:42.215923+0000","last_undegraded":"2024-01-19T04:31:42.215923+0000","last_fullsized":"2024-01-19T04:31:42.215923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667922+0000","last_change":"2024-01-19T04:31:34.735885+0000","last_active":"2024-01-19T04:31:39.667922+0000","last_peered":"2024-01-19T04:31:39.667922+0000","last_clean":"2024-01-19T04:31:39.667922+0000","last_became_active":"2024-01-19T04:31:34.735325+0000","last_became_peered":"2024-01-19T04:31:34.735325+0000","last_unstale":"2024-01-19T04:31:39.667922+0000","last_undegraded":"2024-01-19T04:31:39.667922+0000","last_fullsized":"2024-01-19T04:31:39.667922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:04.694015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822020+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T04:31:39.822020+0000","last_peered":"2024-01-19T04:31:39.822020+0000","last_clean":"2024-01-19T04:31:39.822020+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T04:31:39.822020+0000","last_undegraded":"2024-01-19T04:31:39.822020+0000","last_fullsized":"2024-01-19T04:31:39.822020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.284616+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T04:31:41.284616+0000","last_peered":"2024-01-19T04:31:41.284616+0000","last_clean":"2024-01-19T04:31:41.284616+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T04:31:41.284616+0000","last_undegraded":"2024-01-19T04:31:41.284616+0000","last_fullsized":"2024-01-19T04:31:41.284616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103444+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T04:31:41.103444+0000","last_peered":"2024-01-19T04:31:41.103444+0000","last_clean":"2024-01-19T04:31:41.103444+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T04:31:41.103444+0000","last_undegraded":"2024-01-19T04:31:41.103444+0000","last_fullsized":"2024-01-19T04:31:41.103444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666812+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T04:31:39.666812+0000","last_peered":"2024-01-19T04:31:39.666812+0000","last_clean":"2024-01-19T04:31:39.666812+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T04:31:39.666812+0000","last_undegraded":"2024-01-19T04:31:39.666812+0000","last_fullsized":"2024-01-19T04:31:39.666812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286942+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T04:31:41.286942+0000","last_peered":"2024-01-19T04:31:41.286942+0000","last_clean":"2024-01-19T04:31:41.286942+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T04:31:41.286942+0000","last_undegraded":"2024-01-19T04:31:41.286942+0000","last_fullsized":"2024-01-19T04:31:41.286942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820565+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T04:31:39.820565+0000","last_peered":"2024-01-19T04:31:39.820565+0000","last_clean":"2024-01-19T04:31:39.820565+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T04:31:39.820565+0000","last_undegraded":"2024-01-19T04:31:39.820565+0000","last_fullsized":"2024-01-19T04:31:39.820565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275170+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T04:31:41.275170+0000","last_peered":"2024-01-19T04:31:41.275170+0000","last_clean":"2024-01-19T04:31:41.275170+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T04:31:41.275170+0000","last_undegraded":"2024-01-19T04:31:41.275170+0000","last_fullsized":"2024-01-19T04:31:41.275170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286650+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T04:31:41.286650+0000","last_peered":"2024-01-19T04:31:41.286650+0000","last_clean":"2024-01-19T04:31:41.286650+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T04:31:41.286650+0000","last_undegraded":"2024-01-19T04:31:41.286650+0000","last_fullsized":"2024-01-19T04:31:41.286650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724790+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T04:31:39.724790+0000","last_peered":"2024-01-19T04:31:39.724790+0000","last_clean":"2024-01-19T04:31:39.724790+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T04:31:39.724790+0000","last_undegraded":"2024-01-19T04:31:39.724790+0000","last_fullsized":"2024-01-19T04:31:39.724790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.977977+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T04:31:40.977977+0000","last_peered":"2024-01-19T04:31:40.977977+0000","last_clean":"2024-01-19T04:31:40.977977+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T04:31:40.977977+0000","last_undegraded":"2024-01-19T04:31:40.977977+0000","last_fullsized":"2024-01-19T04:31:40.977977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216628+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T04:31:42.216628+0000","last_peered":"2024-01-19T04:31:42.216628+0000","last_clean":"2024-01-19T04:31:42.216628+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T04:31:42.216628+0000","last_undegraded":"2024-01-19T04:31:42.216628+0000","last_fullsized":"2024-01-19T04:31:42.216628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817644+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T04:31:39.817644+0000","last_peered":"2024-01-19T04:31:39.817644+0000","last_clean":"2024-01-19T04:31:39.817644+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T04:31:39.817644+0000","last_undegraded":"2024-01-19T04:31:39.817644+0000","last_fullsized":"2024-01-19T04:31:39.817644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.944785+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T04:32:12.944785+0000","last_peered":"2024-01-19T04:32:12.944785+0000","last_clean":"2024-01-19T04:32:12.944785+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T04:32:12.944785+0000","last_undegraded":"2024-01-19T04:32:12.944785+0000","last_fullsized":"2024-01-19T04:32:12.944785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979498+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:31:40.979498+0000","last_peered":"2024-01-19T04:31:40.979498+0000","last_clean":"2024-01-19T04:31:40.979498+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:31:40.979498+0000","last_undegraded":"2024-01-19T04:31:40.979498+0000","last_fullsized":"2024-01-19T04:31:40.979498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.221624+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T04:31:42.221624+0000","last_peered":"2024-01-19T04:31:42.221624+0000","last_clean":"2024-01-19T04:31:42.221624+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T04:31:42.221624+0000","last_undegraded":"2024-01-19T04:31:42.221624+0000","last_fullsized":"2024-01-19T04:31:42.221624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978524+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T04:31:40.978524+0000","last_peered":"2024-01-19T04:31:40.978524+0000","last_clean":"2024-01-19T04:31:40.978524+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T04:31:40.978524+0000","last_undegraded":"2024-01-19T04:31:40.978524+0000","last_fullsized":"2024-01-19T04:31:40.978524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.810829+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T04:31:39.810829+0000","last_peered":"2024-01-19T04:31:39.810829+0000","last_clean":"2024-01-19T04:31:39.810829+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T04:31:39.810829+0000","last_undegraded":"2024-01-19T04:31:39.810829+0000","last_fullsized":"2024-01-19T04:31:39.810829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216922+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T04:31:42.216922+0000","last_peered":"2024-01-19T04:31:42.216922+0000","last_clean":"2024-01-19T04:31:42.216922+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T04:31:42.216922+0000","last_undegraded":"2024-01-19T04:31:42.216922+0000","last_fullsized":"2024-01-19T04:31:42.216922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667067+0000","last_change":"2024-01-19T04:31:34.736261+0000","last_active":"2024-01-19T04:31:39.667067+0000","last_peered":"2024-01-19T04:31:39.667067+0000","last_clean":"2024-01-19T04:31:39.667067+0000","last_became_active":"2024-01-19T04:31:34.735525+0000","last_became_peered":"2024-01-19T04:31:34.735525+0000","last_unstale":"2024-01-19T04:31:39.667067+0000","last_undegraded":"2024-01-19T04:31:39.667067+0000","last_fullsized":"2024-01-19T04:31:39.667067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:41.517467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822263+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T04:31:39.822263+0000","last_peered":"2024-01-19T04:31:39.822263+0000","last_clean":"2024-01-19T04:31:39.822263+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T04:31:39.822263+0000","last_undegraded":"2024-01-19T04:31:39.822263+0000","last_fullsized":"2024-01-19T04:31:39.822263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216080+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T04:31:42.216080+0000","last_peered":"2024-01-19T04:31:42.216080+0000","last_clean":"2024-01-19T04:31:42.216080+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T04:31:42.216080+0000","last_undegraded":"2024-01-19T04:31:42.216080+0000","last_fullsized":"2024-01-19T04:31:42.216080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979841+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T04:31:40.979841+0000","last_peered":"2024-01-19T04:31:40.979841+0000","last_clean":"2024-01-19T04:31:40.979841+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T04:31:40.979841+0000","last_undegraded":"2024-01-19T04:31:40.979841+0000","last_fullsized":"2024-01-19T04:31:40.979841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813374+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T04:31:39.813374+0000","last_peered":"2024-01-19T04:31:39.813374+0000","last_clean":"2024-01-19T04:31:39.813374+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T04:31:39.813374+0000","last_undegraded":"2024-01-19T04:31:39.813374+0000","last_fullsized":"2024-01-19T04:31:39.813374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217615+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T04:31:42.217615+0000","last_peered":"2024-01-19T04:31:42.217615+0000","last_clean":"2024-01-19T04:31:42.217615+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T04:31:42.217615+0000","last_undegraded":"2024-01-19T04:31:42.217615+0000","last_fullsized":"2024-01-19T04:31:42.217615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979462+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T04:31:40.979462+0000","last_peered":"2024-01-19T04:31:40.979462+0000","last_clean":"2024-01-19T04:31:40.979462+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T04:31:40.979462+0000","last_undegraded":"2024-01-19T04:31:40.979462+0000","last_fullsized":"2024-01-19T04:31:40.979462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104895+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T04:31:41.104895+0000","last_peered":"2024-01-19T04:31:41.104895+0000","last_clean":"2024-01-19T04:31:41.104895+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T04:31:41.104895+0000","last_undegraded":"2024-01-19T04:31:41.104895+0000","last_fullsized":"2024-01-19T04:31:41.104895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217971+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T04:31:42.217971+0000","last_peered":"2024-01-19T04:31:42.217971+0000","last_clean":"2024-01-19T04:31:42.217971+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T04:31:42.217971+0000","last_undegraded":"2024-01-19T04:31:42.217971+0000","last_fullsized":"2024-01-19T04:31:42.217971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978224+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T04:31:40.978224+0000","last_peered":"2024-01-19T04:31:40.978224+0000","last_clean":"2024-01-19T04:31:40.978224+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T04:31:40.978224+0000","last_undegraded":"2024-01-19T04:31:40.978224+0000","last_fullsized":"2024-01-19T04:31:40.978224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'10","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.949549+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T04:32:12.949549+0000","last_peered":"2024-01-19T04:32:12.949549+0000","last_clean":"2024-01-19T04:32:12.949549+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T04:32:12.949549+0000","last_undegraded":"2024-01-19T04:32:12.949549+0000","last_fullsized":"2024-01-19T04:32:12.949549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216542+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T04:31:42.216542+0000","last_peered":"2024-01-19T04:31:42.216542+0000","last_clean":"2024-01-19T04:31:42.216542+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T04:31:42.216542+0000","last_undegraded":"2024-01-19T04:31:42.216542+0000","last_fullsized":"2024-01-19T04:31:42.216542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008763+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T04:31:41.008763+0000","last_peered":"2024-01-19T04:31:41.008763+0000","last_clean":"2024-01-19T04:31:41.008763+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T04:31:41.008763+0000","last_undegraded":"2024-01-19T04:31:41.008763+0000","last_fullsized":"2024-01-19T04:31:41.008763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008759+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T04:31:41.008759+0000","last_peered":"2024-01-19T04:31:41.008759+0000","last_clean":"2024-01-19T04:31:41.008759+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T04:31:41.008759+0000","last_undegraded":"2024-01-19T04:31:41.008759+0000","last_fullsized":"2024-01-19T04:31:41.008759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.648374+0000","last_change":"2024-01-19T04:31:39.841628+0000","last_active":"2024-01-19T04:31:41.648374+0000","last_peered":"2024-01-19T04:31:41.648374+0000","last_clean":"2024-01-19T04:31:41.648374+0000","last_became_active":"2024-01-19T04:31:39.841239+0000","last_became_peered":"2024-01-19T04:31:39.841239+0000","last_unstale":"2024-01-19T04:31:41.648374+0000","last_undegraded":"2024-01-19T04:31:41.648374+0000","last_fullsized":"2024-01-19T04:31:41.648374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:26:24.623871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978985+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T04:31:40.978985+0000","last_peered":"2024-01-19T04:31:40.978985+0000","last_clean":"2024-01-19T04:31:40.978985+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T04:31:40.978985+0000","last_undegraded":"2024-01-19T04:31:40.978985+0000","last_fullsized":"2024-01-19T04:31:40.978985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.943944+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T04:32:12.943944+0000","last_peered":"2024-01-19T04:32:12.943944+0000","last_clean":"2024-01-19T04:32:12.943944+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T04:32:12.943944+0000","last_undegraded":"2024-01-19T04:32:12.943944+0000","last_fullsized":"2024-01-19T04:32:12.943944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647710+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T04:31:41.647710+0000","last_peered":"2024-01-19T04:31:41.647710+0000","last_clean":"2024-01-19T04:31:41.647710+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T04:31:41.647710+0000","last_undegraded":"2024-01-19T04:31:41.647710+0000","last_fullsized":"2024-01-19T04:31:41.647710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724950+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T04:31:39.724950+0000","last_peered":"2024-01-19T04:31:39.724950+0000","last_clean":"2024-01-19T04:31:39.724950+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T04:31:39.724950+0000","last_undegraded":"2024-01-19T04:31:39.724950+0000","last_fullsized":"2024-01-19T04:31:39.724950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725821+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T04:31:39.725821+0000","last_peered":"2024-01-19T04:31:39.725821+0000","last_clean":"2024-01-19T04:31:39.725821+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T04:31:39.725821+0000","last_undegraded":"2024-01-19T04:31:39.725821+0000","last_fullsized":"2024-01-19T04:31:39.725821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222496+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T04:31:42.222496+0000","last_peered":"2024-01-19T04:31:42.222496+0000","last_clean":"2024-01-19T04:31:42.222496+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T04:31:42.222496+0000","last_undegraded":"2024-01-19T04:31:42.222496+0000","last_fullsized":"2024-01-19T04:31:42.222496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978551+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T04:31:40.978551+0000","last_peered":"2024-01-19T04:31:40.978551+0000","last_clean":"2024-01-19T04:31:40.978551+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T04:31:40.978551+0000","last_undegraded":"2024-01-19T04:31:40.978551+0000","last_fullsized":"2024-01-19T04:31:40.978551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.933754+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T04:32:12.933754+0000","last_peered":"2024-01-19T04:32:12.933754+0000","last_clean":"2024-01-19T04:32:12.933754+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T04:32:12.933754+0000","last_undegraded":"2024-01-19T04:32:12.933754+0000","last_fullsized":"2024-01-19T04:32:12.933754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285152+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T04:31:41.285152+0000","last_peered":"2024-01-19T04:31:41.285152+0000","last_clean":"2024-01-19T04:31:41.285152+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T04:31:41.285152+0000","last_undegraded":"2024-01-19T04:31:41.285152+0000","last_fullsized":"2024-01-19T04:31:41.285152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104147+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T04:31:41.104147+0000","last_peered":"2024-01-19T04:31:41.104147+0000","last_clean":"2024-01-19T04:31:41.104147+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T04:31:41.104147+0000","last_undegraded":"2024-01-19T04:31:41.104147+0000","last_fullsized":"2024-01-19T04:31:41.104147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285986+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T04:31:41.285986+0000","last_peered":"2024-01-19T04:31:41.285986+0000","last_clean":"2024-01-19T04:31:41.285986+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T04:31:41.285986+0000","last_undegraded":"2024-01-19T04:31:41.285986+0000","last_fullsized":"2024-01-19T04:31:41.285986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223324+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T04:31:42.223324+0000","last_peered":"2024-01-19T04:31:42.223324+0000","last_clean":"2024-01-19T04:31:42.223324+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T04:31:42.223324+0000","last_undegraded":"2024-01-19T04:31:42.223324+0000","last_fullsized":"2024-01-19T04:31:42.223324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726771+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T04:31:39.726771+0000","last_peered":"2024-01-19T04:31:39.726771+0000","last_clean":"2024-01-19T04:31:39.726771+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T04:31:39.726771+0000","last_undegraded":"2024-01-19T04:31:39.726771+0000","last_fullsized":"2024-01-19T04:31:39.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.941821+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T04:32:12.941821+0000","last_peered":"2024-01-19T04:32:12.941821+0000","last_clean":"2024-01-19T04:32:12.941821+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T04:32:12.941821+0000","last_undegraded":"2024-01-19T04:32:12.941821+0000","last_fullsized":"2024-01-19T04:32:12.941821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646384+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T04:31:41.646384+0000","last_peered":"2024-01-19T04:31:41.646384+0000","last_clean":"2024-01-19T04:31:41.646384+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T04:31:41.646384+0000","last_undegraded":"2024-01-19T04:31:41.646384+0000","last_fullsized":"2024-01-19T04:31:41.646384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668228+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T04:31:39.668228+0000","last_peered":"2024-01-19T04:31:39.668228+0000","last_clean":"2024-01-19T04:31:39.668228+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T04:31:39.668228+0000","last_undegraded":"2024-01-19T04:31:39.668228+0000","last_fullsized":"2024-01-19T04:31:39.668228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934809+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T04:32:12.934809+0000","last_peered":"2024-01-19T04:32:12.934809+0000","last_clean":"2024-01-19T04:32:12.934809+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T04:32:12.934809+0000","last_undegraded":"2024-01-19T04:32:12.934809+0000","last_fullsized":"2024-01-19T04:32:12.934809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646461+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T04:31:41.646461+0000","last_peered":"2024-01-19T04:31:41.646461+0000","last_clean":"2024-01-19T04:31:41.646461+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T04:31:41.646461+0000","last_undegraded":"2024-01-19T04:31:41.646461+0000","last_fullsized":"2024-01-19T04:31:41.646461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216448+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T04:31:42.216448+0000","last_peered":"2024-01-19T04:31:42.216448+0000","last_clean":"2024-01-19T04:31:42.216448+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T04:31:42.216448+0000","last_undegraded":"2024-01-19T04:31:42.216448+0000","last_fullsized":"2024-01-19T04:31:42.216448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820389+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T04:31:39.820389+0000","last_peered":"2024-01-19T04:31:39.820389+0000","last_clean":"2024-01-19T04:31:39.820389+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T04:31:39.820389+0000","last_undegraded":"2024-01-19T04:31:39.820389+0000","last_fullsized":"2024-01-19T04:31:39.820389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218875+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T04:31:42.218875+0000","last_peered":"2024-01-19T04:31:42.218875+0000","last_clean":"2024-01-19T04:31:42.218875+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T04:31:42.218875+0000","last_undegraded":"2024-01-19T04:31:42.218875+0000","last_fullsized":"2024-01-19T04:31:42.218875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222235+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T04:31:42.222235+0000","last_peered":"2024-01-19T04:31:42.222235+0000","last_clean":"2024-01-19T04:31:42.222235+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T04:31:42.222235+0000","last_undegraded":"2024-01-19T04:31:42.222235+0000","last_fullsized":"2024-01-19T04:31:42.222235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813740+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T04:31:39.813740+0000","last_peered":"2024-01-19T04:31:39.813740+0000","last_clean":"2024-01-19T04:31:39.813740+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T04:31:39.813740+0000","last_undegraded":"2024-01-19T04:31:39.813740+0000","last_fullsized":"2024-01-19T04:31:39.813740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817749+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T04:31:39.817749+0000","last_peered":"2024-01-19T04:31:39.817749+0000","last_clean":"2024-01-19T04:31:39.817749+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T04:31:39.817749+0000","last_undegraded":"2024-01-19T04:31:39.817749+0000","last_fullsized":"2024-01-19T04:31:39.817749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.011146+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T04:31:41.011146+0000","last_peered":"2024-01-19T04:31:41.011146+0000","last_clean":"2024-01-19T04:31:41.011146+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T04:31:41.011146+0000","last_undegraded":"2024-01-19T04:31:41.011146+0000","last_fullsized":"2024-01-19T04:31:41.011146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725708+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T04:31:39.725708+0000","last_peered":"2024-01-19T04:31:39.725708+0000","last_clean":"2024-01-19T04:31:39.725708+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T04:31:39.725708+0000","last_undegraded":"2024-01-19T04:31:39.725708+0000","last_fullsized":"2024-01-19T04:31:39.725708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275109+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T04:31:41.275109+0000","last_peered":"2024-01-19T04:31:41.275109+0000","last_clean":"2024-01-19T04:31:41.275109+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T04:31:41.275109+0000","last_undegraded":"2024-01-19T04:31:41.275109+0000","last_fullsized":"2024-01-19T04:31:41.275109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.064237+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T04:32:13.064237+0000","last_peered":"2024-01-19T04:32:13.064237+0000","last_clean":"2024-01-19T04:32:13.064237+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T04:32:13.064237+0000","last_undegraded":"2024-01-19T04:32:13.064237+0000","last_fullsized":"2024-01-19T04:32:13.064237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103673+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T04:31:41.103673+0000","last_peered":"2024-01-19T04:31:41.103673+0000","last_clean":"2024-01-19T04:31:41.103673+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T04:31:41.103673+0000","last_undegraded":"2024-01-19T04:31:41.103673+0000","last_fullsized":"2024-01-19T04:31:41.103673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647676+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T04:31:41.647676+0000","last_peered":"2024-01-19T04:31:41.647676+0000","last_clean":"2024-01-19T04:31:41.647676+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T04:31:41.647676+0000","last_undegraded":"2024-01-19T04:31:41.647676+0000","last_fullsized":"2024-01-19T04:31:41.647676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008510+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T04:31:41.008510+0000","last_peered":"2024-01-19T04:31:41.008510+0000","last_clean":"2024-01-19T04:31:41.008510+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T04:31:41.008510+0000","last_undegraded":"2024-01-19T04:31:41.008510+0000","last_fullsized":"2024-01-19T04:31:41.008510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.812464+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T04:31:39.812464+0000","last_peered":"2024-01-19T04:31:39.812464+0000","last_clean":"2024-01-19T04:31:39.812464+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T04:31:39.812464+0000","last_undegraded":"2024-01-19T04:31:39.812464+0000","last_fullsized":"2024-01-19T04:31:39.812464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666159+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T04:31:39.666159+0000","last_peered":"2024-01-19T04:31:39.666159+0000","last_clean":"2024-01-19T04:31:39.666159+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T04:31:39.666159+0000","last_undegraded":"2024-01-19T04:31:39.666159+0000","last_fullsized":"2024-01-19T04:31:39.666159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725587+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T04:31:39.725587+0000","last_peered":"2024-01-19T04:31:39.725587+0000","last_clean":"2024-01-19T04:31:39.725587+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T04:31:39.725587+0000","last_undegraded":"2024-01-19T04:31:39.725587+0000","last_fullsized":"2024-01-19T04:31:39.725587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821683+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T04:31:39.821683+0000","last_peered":"2024-01-19T04:31:39.821683+0000","last_clean":"2024-01-19T04:31:39.821683+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T04:31:39.821683+0000","last_undegraded":"2024-01-19T04:31:39.821683+0000","last_fullsized":"2024-01-19T04:31:39.821683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822108+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T04:31:39.822108+0000","last_peered":"2024-01-19T04:31:39.822108+0000","last_clean":"2024-01-19T04:31:39.822108+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T04:31:39.822108+0000","last_undegraded":"2024-01-19T04:31:39.822108+0000","last_fullsized":"2024-01-19T04:31:39.822108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009546+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T04:31:41.009546+0000","last_peered":"2024-01-19T04:31:41.009546+0000","last_clean":"2024-01-19T04:31:41.009546+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T04:31:41.009546+0000","last_undegraded":"2024-01-19T04:31:41.009546+0000","last_fullsized":"2024-01-19T04:31:41.009546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821774+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T04:31:39.821774+0000","last_peered":"2024-01-19T04:31:39.821774+0000","last_clean":"2024-01-19T04:31:39.821774+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T04:31:39.821774+0000","last_undegraded":"2024-01-19T04:31:39.821774+0000","last_fullsized":"2024-01-19T04:31:39.821774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666053+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T04:31:39.666053+0000","last_peered":"2024-01-19T04:31:39.666053+0000","last_clean":"2024-01-19T04:31:39.666053+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T04:31:39.666053+0000","last_undegraded":"2024-01-19T04:31:39.666053+0000","last_fullsized":"2024-01-19T04:31:39.666053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817657+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T04:31:39.817657+0000","last_peered":"2024-01-19T04:31:39.817657+0000","last_clean":"2024-01-19T04:31:39.817657+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T04:31:39.817657+0000","last_undegraded":"2024-01-19T04:31:39.817657+0000","last_fullsized":"2024-01-19T04:31:39.817657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665952+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T04:31:39.665952+0000","last_peered":"2024-01-19T04:31:39.665952+0000","last_clean":"2024-01-19T04:31:39.665952+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T04:31:39.665952+0000","last_undegraded":"2024-01-19T04:31:39.665952+0000","last_fullsized":"2024-01-19T04:31:39.665952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725169+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T04:31:39.725169+0000","last_peered":"2024-01-19T04:31:39.725169+0000","last_clean":"2024-01-19T04:31:39.725169+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T04:31:39.725169+0000","last_undegraded":"2024-01-19T04:31:39.725169+0000","last_fullsized":"2024-01-19T04:31:39.725169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008993+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T04:31:41.008993+0000","last_peered":"2024-01-19T04:31:41.008993+0000","last_clean":"2024-01-19T04:31:41.008993+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T04:31:41.008993+0000","last_undegraded":"2024-01-19T04:31:41.008993+0000","last_fullsized":"2024-01-19T04:31:41.008993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979162+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T04:31:40.979162+0000","last_peered":"2024-01-19T04:31:40.979162+0000","last_clean":"2024-01-19T04:31:40.979162+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T04:31:40.979162+0000","last_undegraded":"2024-01-19T04:31:40.979162+0000","last_fullsized":"2024-01-19T04:31:40.979162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813279+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T04:31:39.813279+0000","last_peered":"2024-01-19T04:31:39.813279+0000","last_clean":"2024-01-19T04:31:39.813279+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T04:31:39.813279+0000","last_undegraded":"2024-01-19T04:31:39.813279+0000","last_fullsized":"2024-01-19T04:31:39.813279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668465+0000","last_change":"2024-01-19T04:31:34.743868+0000","last_active":"2024-01-19T04:31:39.668465+0000","last_peered":"2024-01-19T04:31:39.668465+0000","last_clean":"2024-01-19T04:31:39.668465+0000","last_became_active":"2024-01-19T04:31:34.743503+0000","last_became_peered":"2024-01-19T04:31:34.743503+0000","last_unstale":"2024-01-19T04:31:39.668465+0000","last_undegraded":"2024-01-19T04:31:39.668465+0000","last_fullsized":"2024-01-19T04:31:39.668465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:22.598439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665835+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T04:31:39.665835+0000","last_peered":"2024-01-19T04:31:39.665835+0000","last_clean":"2024-01-19T04:31:39.665835+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T04:31:39.665835+0000","last_undegraded":"2024-01-19T04:31:39.665835+0000","last_fullsized":"2024-01-19T04:31:39.665835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820435+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T04:31:39.820435+0000","last_peered":"2024-01-19T04:31:39.820435+0000","last_clean":"2024-01-19T04:31:39.820435+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T04:31:39.820435+0000","last_undegraded":"2024-01-19T04:31:39.820435+0000","last_fullsized":"2024-01-19T04:31:39.820435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724966+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T04:31:39.724966+0000","last_peered":"2024-01-19T04:31:39.724966+0000","last_clean":"2024-01-19T04:31:39.724966+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T04:31:39.724966+0000","last_undegraded":"2024-01-19T04:31:39.724966+0000","last_fullsized":"2024-01-19T04:31:39.724966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817772+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T04:31:39.817772+0000","last_peered":"2024-01-19T04:31:39.817772+0000","last_clean":"2024-01-19T04:31:39.817772+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T04:31:39.817772+0000","last_undegraded":"2024-01-19T04:31:39.817772+0000","last_fullsized":"2024-01-19T04:31:39.817772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104062+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T04:31:41.104062+0000","last_peered":"2024-01-19T04:31:41.104062+0000","last_clean":"2024-01-19T04:31:41.104062+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T04:31:41.104062+0000","last_undegraded":"2024-01-19T04:31:41.104062+0000","last_fullsized":"2024-01-19T04:31:41.104062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009588+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T04:31:41.009588+0000","last_peered":"2024-01-19T04:31:41.009588+0000","last_clean":"2024-01-19T04:31:41.009588+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T04:31:41.009588+0000","last_undegraded":"2024-01-19T04:31:41.009588+0000","last_fullsized":"2024-01-19T04:31:41.009588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009336+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T04:31:41.009336+0000","last_peered":"2024-01-19T04:31:41.009336+0000","last_clean":"2024-01-19T04:31:41.009336+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T04:31:41.009336+0000","last_undegraded":"2024-01-19T04:31:41.009336+0000","last_fullsized":"2024-01-19T04:31:41.009336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979732+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T04:31:40.979732+0000","last_peered":"2024-01-19T04:31:40.979732+0000","last_clean":"2024-01-19T04:31:40.979732+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T04:31:40.979732+0000","last_undegraded":"2024-01-19T04:31:40.979732+0000","last_fullsized":"2024-01-19T04:31:40.979732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.809480+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T04:31:39.809480+0000","last_peered":"2024-01-19T04:31:39.809480+0000","last_clean":"2024-01-19T04:31:39.809480+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T04:31:39.809480+0000","last_undegraded":"2024-01-19T04:31:39.809480+0000","last_fullsized":"2024-01-19T04:31:39.809480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978084+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T04:31:40.978084+0000","last_peered":"2024-01-19T04:31:40.978084+0000","last_clean":"2024-01-19T04:31:40.978084+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T04:31:40.978084+0000","last_undegraded":"2024-01-19T04:31:40.978084+0000","last_fullsized":"2024-01-19T04:31:40.978084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665994+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T04:31:39.665994+0000","last_peered":"2024-01-19T04:31:39.665994+0000","last_clean":"2024-01-19T04:31:39.665994+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T04:31:39.665994+0000","last_undegraded":"2024-01-19T04:31:39.665994+0000","last_fullsized":"2024-01-19T04:31:39.665994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978264+0000","last_change":"2024-01-19T04:31:33.071431+0000","last_active":"2024-01-19T04:31:40.978264+0000","last_peered":"2024-01-19T04:31:40.978264+0000","last_clean":"2024-01-19T04:31:40.978264+0000","last_became_active":"2024-01-19T04:31:33.070826+0000","last_became_peered":"2024-01-19T04:31:33.070826+0000","last_unstale":"2024-01-19T04:31:40.978264+0000","last_undegraded":"2024-01-19T04:31:40.978264+0000","last_fullsized":"2024-01-19T04:31:40.978264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:36:31.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666838+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T04:31:39.666838+0000","last_peered":"2024-01-19T04:31:39.666838+0000","last_clean":"2024-01-19T04:31:39.666838+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T04:31:39.666838+0000","last_undegraded":"2024-01-19T04:31:39.666838+0000","last_fullsized":"2024-01-19T04:31:39.666838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724952+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T04:31:39.724952+0000","last_peered":"2024-01-19T04:31:39.724952+0000","last_clean":"2024-01-19T04:31:39.724952+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T04:31:39.724952+0000","last_undegraded":"2024-01-19T04:31:39.724952+0000","last_fullsized":"2024-01-19T04:31:39.724952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822589+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T04:31:39.822589+0000","last_peered":"2024-01-19T04:31:39.822589+0000","last_clean":"2024-01-19T04:31:39.822589+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T04:31:39.822589+0000","last_undegraded":"2024-01-19T04:31:39.822589+0000","last_fullsized":"2024-01-19T04:31:39.822589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979575+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T04:31:40.979575+0000","last_peered":"2024-01-19T04:31:40.979575+0000","last_clean":"2024-01-19T04:31:40.979575+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T04:31:40.979575+0000","last_undegraded":"2024-01-19T04:31:40.979575+0000","last_fullsized":"2024-01-19T04:31:40.979575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6023,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":11334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476757,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.03},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.0649999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476758,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":119306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.503}]},{"osd":2,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.877}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.075},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.1379999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.171}]}]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":122405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.7309999999999999,"5min":5.7309999999999999,"15min":5.7309999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7850000000000001,"5min":5.7850000000000001,"15min":5.7850000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0140000000000002,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.622},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.125}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":1.161},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":5.6920000000000002,"5min":5.6920000000000002,"15min":5.6920000000000002},"last":1.05}]}]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":119236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.04}]},{"osd":1,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.103},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.014},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.1819999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.125},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.208}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":118600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.63400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.746}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.1950000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.997}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.04},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.403}]}]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.503}]},{"osd":1,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.873}]},{"osd":7,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0369999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":892928,"data_stored":709424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.87},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.1379999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.234},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.113}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.165},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.214}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0720000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":709480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68999999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.877},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.153}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.228},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.024}]},{"osd":7,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.2030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:32:17.457 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:32:17.457 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-19T04:32:17.457 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-19T04:32:17.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-19T04:32:17.458 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-19T04:32:17.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.613+0000 7fe2ff299640 1 Processor -- start 2024-01-19T04:32:17.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.613+0000 7fe2ff299640 1 -- start start 2024-01-19T04:32:17.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2ff299640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 0x7fe2f815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:17.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2ff299640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2f806f350 0x7fe2f80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:17.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2ff299640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f8158390 con 0x7fe2f8151600 2024-01-19T04:32:17.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2ff299640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f815b0e0 con 0x7fe2f806f350 2024-01-19T04:32:17.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2ff299640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8157b70 con 0x7fe2f81519e0 2024-01-19T04:32:17.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2fc834640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 0x7fe2f815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2fc834640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 0x7fe2f815b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:37938/0 (socket says 172.21.15.133:37938) 2024-01-19T04:32:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.617+0000 7fe2fc834640 1 -- 172.21.15.133:0/2303208909 learned_addr learned my addr 172.21.15.133:0/2303208909 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:17.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.621+0000 7fe2fd836640 1 --2- 172.21.15.133:0/2303208909 >> v2:172.21.15.156:3300/0 conn(0x7fe2f806f350 0x7fe2f80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:17.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.625+0000 7fe2fc834640 1 -- 172.21.15.133:0/2303208909 >> v2:172.21.15.156:3300/0 conn(0x7fe2f806f350 msgr2=0x7fe2f80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:17.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.625+0000 7fe2fc834640 1 --2- 172.21.15.133:0/2303208909 >> v2:172.21.15.156:3300/0 conn(0x7fe2f806f350 0x7fe2f80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.625+0000 7fe2fc834640 1 -- 172.21.15.133:0/2303208909 >> v1:172.21.15.156:6789/0 conn(0x7fe2f8151600 legacy=0x7fe2f8157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:17.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.625+0000 7fe2fc834640 1 -- 172.21.15.133:0/2303208909 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f8157dd0 con 0x7fe2f81519e0 2024-01-19T04:32:17.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.629+0000 7fe2fc834640 1 --2- 172.21.15.133:0/2303208909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 0x7fe2f815b570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10af248a7253c24d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2effff640 1 -- 172.21.15.133:0/2303208909 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80ac410 con 0x7fe2f81519e0 2024-01-19T04:32:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2effff640 1 -- 172.21.15.133:0/2303208909 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e80ac570 con 0x7fe2f81519e0 2024-01-19T04:32:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2effff640 1 -- 172.21.15.133:0/2303208909 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80ac900 con 0x7fe2f81519e0 2024-01-19T04:32:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 -- 172.21.15.133:0/2303208909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 msgr2=0x7fe2f815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2303208909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 0x7fe2f815b570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e801c500 comp rx=0 tx=0).stop 2024-01-19T04:32:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 -- 172.21.15.133:0/2303208909 shutdown_connections 2024-01-19T04:32:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2303208909 >> v2:172.21.15.156:3300/0 conn(0x7fe2f806f350 0x7fe2f80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2303208909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f81519e0 0x7fe2f815b570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 -- 172.21.15.133:0/2303208909 >> 172.21.15.133:0/2303208909 conn(0x7fe2f806d590 msgr2=0x7fe2f8066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:17.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 -- 172.21.15.133:0/2303208909 shutdown_connections 2024-01-19T04:32:17.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.641+0000 7fe2ff299640 1 -- 172.21.15.133:0/2303208909 wait complete. 2024-01-19T04:32:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 Processor -- start 2024-01-19T04:32:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 -- start start 2024-01-19T04:32:17.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f806f350 0x7fe2f80c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2f8151600 0x7fe2f81585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f814b220 0x7fe2f81428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f81f0200 con 0x7fe2f806f350 2024-01-19T04:32:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815a190 con 0x7fe2f8151600 2024-01-19T04:32:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2ff299640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815a470 con 0x7fe2f814b220 2024-01-19T04:32:17.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.645+0000 7fe2fc834640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2f8151600 0x7fe2f81585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:17.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.649+0000 7fe2fc834640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2f8151600 0x7fe2f81585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44454/0 (socket says 172.21.15.133:44454) 2024-01-19T04:32:17.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.649+0000 7fe2fc834640 1 -- 172.21.15.133:0/2649531033 learned_addr learned my addr 172.21.15.133:0/2649531033 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:17.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.649+0000 7fe2fd836640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f814b220 0x7fe2f81428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.649+0000 7fe2fd035640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f806f350 0x7fe2f80c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.653+0000 7fe2fd035640 1 -- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f814b220 msgr2=0x7fe2f81428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.653+0000 7fe2fd035640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f814b220 0x7fe2f81428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.653+0000 7fe2fd035640 1 -- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2f8151600 msgr2=0x7fe2f81585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.653+0000 7fe2fd035640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2f8151600 0x7fe2f81585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.653+0000 7fe2fd035640 1 -- 172.21.15.133:0/2649531033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80094d0 con 0x7fe2f806f350 2024-01-19T04:32:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.657+0000 7fe2fd035640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f806f350 0x7fe2f80c96c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400c360 tx=0x7fe2f400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.665+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4003600 con 0x7fe2f806f350 2024-01-19T04:32:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.665+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f4003760 con 0x7fe2f806f350 2024-01-19T04:32:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.665+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4003b50 con 0x7fe2f806f350 2024-01-19T04:32:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.665+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f81f04c0 con 0x7fe2f806f350 2024-01-19T04:32:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.665+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f81f0a80 con 0x7fe2f806f350 2024-01-19T04:32:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.665+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f8071fa0 con 0x7fe2f806f350 2024-01-19T04:32:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.953+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe2f4003cb0 con 0x7fe2f806f350 2024-01-19T04:32:17.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.953+0000 7fe2edffb640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe2dc066550 0x7fe2dc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:17.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.953+0000 7fe2fc834640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe2dc066550 0x7fe2dc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:17.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.957+0000 7fe2fc834640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe2dc066550 0x7fe2dc068a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e80a6040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:17.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.989+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2f40548c0 con 0x7fe2f806f350 2024-01-19T04:32:17.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:17.989+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe2f4050c00 con 0x7fe2f806f350 2024-01-19T04:32:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.197+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe2f8074340 con 0x7fe2f806f350 2024-01-19T04:32:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.365+0000 7fe2edffb640 1 -- 172.21.15.133:0/2649531033 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+164176 (secure 0 0 0) 0x7fe2f4017090 con 0x7fe2f806f350 2024-01-19T04:32:18.366 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:18.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe2dc066550 msgr2=0x7fe2dc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:18.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe2dc066550 0x7fe2dc068a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e80a6040 comp rx=0 tx=0).stop 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f806f350 msgr2=0x7fe2f80c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f806f350 0x7fe2f80c96c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400c360 tx=0x7fe2f400c820 comp rx=0 tx=0).stop 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 shutdown_connections 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe2dc066550 0x7fe2dc068a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2f8151600 0x7fe2f81585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2f814b220 0x7fe2f81428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 --2- 172.21.15.133:0/2649531033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f806f350 0x7fe2f80c96c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 >> 172.21.15.133:0/2649531033 conn(0x7fe2f806d590 msgr2=0x7fe2f814b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 shutdown_connections 2024-01-19T04:32:18.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.369+0000 7fe2ff299640 1 -- 172.21.15.133:0/2649531033 wait complete. 2024-01-19T04:32:18.387 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"active_gid":4113,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2555181525},{"type":"v1","addr":"172.21.15.156:6801","nonce":2555181525}]},"active_addr":"172.21.15.156:6801/2555181525","active_change":"2024-01-19T04:30:33.159016+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3711596177}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2863269353}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1832732607}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3345229554}]}]} 2024-01-19T04:32:18.392 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-19T04:32:18.392 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-19T04:32:18.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:18.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 Processor -- start 2024-01-19T04:32:18.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 -- start start 2024-01-19T04:32:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd60006b520 0x7fd60006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd60006b900 0x7fd600153330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6000c9b70 con 0x7fd60015a470 2024-01-19T04:32:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000c9e50 con 0x7fd60006b520 2024-01-19T04:32:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.529+0000 7fd606f17640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000ca130 con 0x7fd60006b900 2024-01-19T04:32:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd60006b520 0x7fd60006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd60006b520 0x7fd60006bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56312/0 (socket says 172.21.15.133:56312) 2024-01-19T04:32:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 -- 172.21.15.133:0/3175659763 learned_addr learned my addr 172.21.15.133:0/3175659763 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:18.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 -- 172.21.15.133:0/3175659763 >> v2:172.21.15.156:3300/0 conn(0x7fd60006b900 msgr2=0x7fd600153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:18.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 --2- 172.21.15.133:0/3175659763 >> v2:172.21.15.156:3300/0 conn(0x7fd60006b900 0x7fd600153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 -- 172.21.15.133:0/3175659763 >> v1:172.21.15.156:6789/0 conn(0x7fd60015a470 legacy=0x7fd6000c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:18.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.533+0000 7fd604cb3640 1 -- 172.21.15.133:0/3175659763 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000ca410 con 0x7fd60006b520 2024-01-19T04:32:18.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.537+0000 7fd604cb3640 1 --2- 172.21.15.133:0/3175659763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b520 0x7fd60006bfe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd600067440 tx=0x7fd5f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca930ab9cd016666 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd5ff7fe640 1 -- 172.21.15.133:0/3175659763 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40aa610 con 0x7fd60006b520 2024-01-19T04:32:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd5ff7fe640 1 -- 172.21.15.133:0/3175659763 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f40a6040 con 0x7fd60006b520 2024-01-19T04:32:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd5ff7fe640 1 -- 172.21.15.133:0/3175659763 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40aa990 con 0x7fd60006b520 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 -- 172.21.15.133:0/3175659763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b520 msgr2=0x7fd60006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 --2- 172.21.15.133:0/3175659763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b520 0x7fd60006bfe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd600067440 tx=0x7fd5f401c490 comp rx=0 tx=0).stop 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 -- 172.21.15.133:0/3175659763 shutdown_connections 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 --2- 172.21.15.133:0/3175659763 >> v2:172.21.15.156:3300/0 conn(0x7fd60006b900 0x7fd600153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 --2- 172.21.15.133:0/3175659763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b520 0x7fd60006bfe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 -- 172.21.15.133:0/3175659763 >> 172.21.15.133:0/3175659763 conn(0x7fd6000cb910 msgr2=0x7fd6000cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 -- 172.21.15.133:0/3175659763 shutdown_connections 2024-01-19T04:32:18.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 -- 172.21.15.133:0/3175659763 wait complete. 2024-01-19T04:32:18.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 Processor -- start 2024-01-19T04:32:18.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.545+0000 7fd606f17640 1 -- start start 2024-01-19T04:32:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd606f17640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60006b520 0x7fd600154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd606f17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 0x7fd6001f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd606f17640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60015a470 0x7fd60015d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd606f17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001f5bb0 con 0x7fd60006b900 2024-01-19T04:32:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd606f17640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000b48b0 con 0x7fd60015a470 2024-01-19T04:32:18.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd606f17640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000b4b90 con 0x7fd60006b520 2024-01-19T04:32:18.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd5fffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 0x7fd6001f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:18.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd5fffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 0x7fd6001f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56322/0 (socket says 172.21.15.133:56322) 2024-01-19T04:32:18.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.549+0000 7fd5fffff640 1 -- 172.21.15.133:0/1867851060 learned_addr learned my addr 172.21.15.133:0/1867851060 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.553+0000 7fd5fffff640 1 -- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60006b520 msgr2=0x7fd600154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.553+0000 7fd5fffff640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60006b520 0x7fd600154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.553+0000 7fd5fffff640 1 -- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60015a470 msgr2=0x7fd60015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.553+0000 7fd5fffff640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60015a470 0x7fd60015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.553+0000 7fd5fffff640 1 -- 172.21.15.133:0/1867851060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40094d0 con 0x7fd60006b900 2024-01-19T04:32:18.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.557+0000 7fd5fffff640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 0x7fd6001f6670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000b550 tx=0x7fd5f000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.561+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0010870 con 0x7fd60006b900 2024-01-19T04:32:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.561+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f00109f0 con 0x7fd60006b900 2024-01-19T04:32:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.561+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0010da0 con 0x7fd60006b900 2024-01-19T04:32:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.561+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6000b4e70 con 0x7fd60006b900 2024-01-19T04:32:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.561+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6001f6150 con 0x7fd60006b900 2024-01-19T04:32:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.561+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600074340 con 0x7fd60006b900 2024-01-19T04:32:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.849+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd5f0023480 con 0x7fd60006b900 2024-01-19T04:32:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.849+0000 7fd5fd7fa640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd5ec066550 0x7fd5ec068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.853+0000 7fd604cb3640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd5ec066550 0x7fd5ec068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:18.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.853+0000 7fd604cb3640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd5ec066550 0x7fd5ec068a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40ae000 tx=0x7fd5f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:18.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.865+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5f00559c0 con 0x7fd60006b900 2024-01-19T04:32:18.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:18.865+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd5f0055090 con 0x7fd60006b900 2024-01-19T04:32:19.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.029+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd600157900 con 0x7fd60006b900 2024-01-19T04:32:19.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.121+0000 7fd5fd7fa640 1 -- 172.21.15.133:0/1867851060 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7fd5f001e090 con 0x7fd60006b900 2024-01-19T04:32:19.122 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:19.122 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd5ec066550 msgr2=0x7fd5ec068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd5ec066550 0x7fd5ec068a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40ae000 tx=0x7fd5f4008040 comp rx=0 tx=0).stop 2024-01-19T04:32:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 msgr2=0x7fd6001f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 0x7fd6001f6670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000b550 tx=0x7fd5f000ba10 comp rx=0 tx=0).stop 2024-01-19T04:32:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 shutdown_connections 2024-01-19T04:32:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd5ec066550 0x7fd5ec068a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60015a470 0x7fd60015d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd60006b900 0x7fd6001f6670 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 --2- 172.21.15.133:0/1867851060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60006b520 0x7fd600154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 >> 172.21.15.133:0/1867851060 conn(0x7fd6000cb910 msgr2=0x7fd6001516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 shutdown_connections 2024-01-19T04:32:19.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.125+0000 7fd606f17640 1 -- 172.21.15.133:0/1867851060 wait complete. 2024-01-19T04:32:19.145 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-19T04:32:19.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:19.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.265+0000 7fa1c23cd640 1 Processor -- start 2024-01-19T04:32:19.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.265+0000 7fa1c23cd640 1 -- start start 2024-01-19T04:32:19.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c23cd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1bc151600 0x7fa1bc15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:19.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c23cd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1bc06f350 0x7fa1bc0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:19.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c23cd640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc158390 con 0x7fa1bc1519e0 2024-01-19T04:32:19.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c23cd640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc15b0e0 con 0x7fa1bc06f350 2024-01-19T04:32:19.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c23cd640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc157b70 con 0x7fa1bc151600 2024-01-19T04:32:19.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c096a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1bc06f350 0x7fa1bc0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:19.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c096a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1bc06f350 0x7fa1bc0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56334/0 (socket says 172.21.15.133:56334) 2024-01-19T04:32:19.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.269+0000 7fa1c096a640 1 -- 172.21.15.133:0/1549544640 learned_addr learned my addr 172.21.15.133:0/1549544640 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:19.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.273+0000 7fa1c096a640 1 -- 172.21.15.133:0/1549544640 >> v2:172.21.15.156:3300/0 conn(0x7fa1bc151600 msgr2=0x7fa1bc15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:19.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.273+0000 7fa1c096a640 1 --2- 172.21.15.133:0/1549544640 >> v2:172.21.15.156:3300/0 conn(0x7fa1bc151600 0x7fa1bc15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.273+0000 7fa1c096a640 1 -- 172.21.15.133:0/1549544640 >> v1:172.21.15.156:6789/0 conn(0x7fa1bc1519e0 legacy=0x7fa1bc157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:19.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.273+0000 7fa1c096a640 1 -- 172.21.15.133:0/1549544640 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc157dd0 con 0x7fa1bc06f350 2024-01-19T04:32:19.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.277+0000 7fa1c096a640 1 --2- 172.21.15.133:0/1549544640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc06f350 0x7fa1bc0c7660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc066e80 tx=0x7fa1ac01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906faf69670e10b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1baffd640 1 -- 172.21.15.133:0/1549544640 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0ac410 con 0x7fa1bc06f350 2024-01-19T04:32:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1baffd640 1 -- 172.21.15.133:0/1549544640 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac0ac570 con 0x7fa1bc06f350 2024-01-19T04:32:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1baffd640 1 -- 172.21.15.133:0/1549544640 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0ac900 con 0x7fa1bc06f350 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 -- 172.21.15.133:0/1549544640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc06f350 msgr2=0x7fa1bc0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/1549544640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc06f350 0x7fa1bc0c7660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc066e80 tx=0x7fa1ac01c4c0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 -- 172.21.15.133:0/1549544640 shutdown_connections 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/1549544640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc06f350 0x7fa1bc0c7660 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/1549544640 >> v2:172.21.15.156:3300/0 conn(0x7fa1bc151600 0x7fa1bc15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 -- 172.21.15.133:0/1549544640 >> 172.21.15.133:0/1549544640 conn(0x7fa1bc06d590 msgr2=0x7fa1bc066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 -- 172.21.15.133:0/1549544640 shutdown_connections 2024-01-19T04:32:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.281+0000 7fa1c23cd640 1 -- 172.21.15.133:0/1549544640 wait complete. 2024-01-19T04:32:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 Processor -- start 2024-01-19T04:32:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 -- start start 2024-01-19T04:32:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1bc06f350 0x7fa1bc1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 0x7fa1bc144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1bc0c9b70 0x7fa1bc13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0ca8e0 con 0x7fa1bc151600 2024-01-19T04:32:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc143f60 con 0x7fa1bc0c9b70 2024-01-19T04:32:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1c23cd640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0ca320 con 0x7fa1bc06f350 2024-01-19T04:32:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1bb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 0x7fa1bc144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1bb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 0x7fa1bc144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56336/0 (socket says 172.21.15.133:56336) 2024-01-19T04:32:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.285+0000 7fa1bb7fe640 1 -- 172.21.15.133:0/3593920230 learned_addr learned my addr 172.21.15.133:0/3593920230 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:19.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.289+0000 7fa1bb7fe640 1 -- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1bc06f350 msgr2=0x7fa1bc1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.289+0000 7fa1bb7fe640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1bc06f350 0x7fa1bc1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.289+0000 7fa1bb7fe640 1 -- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1bc0c9b70 msgr2=0x7fa1bc13f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.289+0000 7fa1bb7fe640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1bc0c9b70 0x7fa1bc13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.289+0000 7fa1bb7fe640 1 -- 172.21.15.133:0/3593920230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0094d0 con 0x7fa1bc151600 2024-01-19T04:32:19.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.293+0000 7fa1bb7fe640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 0x7fa1bc144930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c490 tx=0x7fa1b0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.297+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0003600 con 0x7fa1bc151600 2024-01-19T04:32:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.297+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0003780 con 0x7fa1bc151600 2024-01-19T04:32:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.297+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0003b30 con 0x7fa1bc151600 2024-01-19T04:32:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.297+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc0ca600 con 0x7fa1bc151600 2024-01-19T04:32:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.297+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc14b320 con 0x7fa1bc151600 2024-01-19T04:32:19.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.297+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc06e740 con 0x7fa1bc151600 2024-01-19T04:32:19.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.573+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa1b0003c90 con 0x7fa1bc151600 2024-01-19T04:32:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.573+0000 7fa1b8ff9640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa1a8066500 0x7fa1a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:19.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.573+0000 7fa1bbfff640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa1a8066500 0x7fa1a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:19.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.573+0000 7fa1bbfff640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa1a8066500 0x7fa1a80689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400ab90 tx=0x7fa1b4009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:19.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.609+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1b0054a10 con 0x7fa1bc151600 2024-01-19T04:32:19.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.609+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa1b0050650 con 0x7fa1bc151600 2024-01-19T04:32:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.781+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1bc143a50 con 0x7fa1bc151600 2024-01-19T04:32:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.897+0000 7fa1b8ff9640 1 -- 172.21.15.133:0/3593920230 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7fa1bc143a50 con 0x7fa1bc151600 2024-01-19T04:32:19.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:19.901 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:19.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa1a8066500 msgr2=0x7fa1a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa1a8066500 0x7fa1a80689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400ab90 tx=0x7fa1b4009250 comp rx=0 tx=0).stop 2024-01-19T04:32:19.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 msgr2=0x7fa1bc144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:19.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 0x7fa1bc144930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c490 tx=0x7fa1b0001e80 comp rx=0 tx=0).stop 2024-01-19T04:32:19.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 shutdown_connections 2024-01-19T04:32:19.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa1a8066500 0x7fa1a80689c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1bc0c9b70 0x7fa1bc13f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1bc151600 0x7fa1bc144930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 --2- 172.21.15.133:0/3593920230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1bc06f350 0x7fa1bc1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:19.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 >> 172.21.15.133:0/3593920230 conn(0x7fa1bc06d590 msgr2=0x7fa1bc14b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:19.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 shutdown_connections 2024-01-19T04:32:19.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:19.901+0000 7fa1c23cd640 1 -- 172.21.15.133:0/3593920230 wait complete. 2024-01-19T04:32:19.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-19T04:32:19.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-19T04:32:19.923 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-19T04:32:19.923 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-19T04:32:19.923 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-19T04:32:19.924 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-19T04:32:19.924 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-19T04:32:19.925 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-19T04:32:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7f5879e53640 1 Processor -- start 2024-01-19T04:32:20.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7f5879e53640 1 -- start start 2024-01-19T04:32:20.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7f5879e53640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c7ed0 0x7f5874161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7f5879e53640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740c11a0 con 0x7f58740c82b0 2024-01-19T04:32:20.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7f5879e53640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5874161060 con 0x7f58740c0660 2024-01-19T04:32:20.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7f5879e53640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c0be0 con 0x7f58740c7ed0 2024-01-19T04:32:20.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f58737fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c7ed0 0x7f5874161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f5873fff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f58740c0660 0x7f58741576d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:54596/0 (socket says 172.21.15.133:54596) 2024-01-19T04:32:20.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f5873fff640 1 -- 172.21.15.133:0/1952164317 learned_addr learned my addr 172.21.15.133:0/1952164317 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7fce58934640 1 Processor -- start 2024-01-19T04:32:20.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7fce58934640 1 -- start start 2024-01-19T04:32:20.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7fce58934640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fce4c045450 0x7fce4c0fd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7fce58934640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c050e70 con 0x7fce4c0f6bc0 2024-01-19T04:32:20.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7fce58934640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0467c0 con 0x7fce4c046c50 2024-01-19T04:32:20.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.113+0000 7fce58934640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0459a0 con 0x7fce4c045450 2024-01-19T04:32:20.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 Processor -- start 2024-01-19T04:32:20.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 -- start start 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7fc5e4c1a640 1 Processor -- start 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7fc5e4c1a640 1 -- start start 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46641539f0 0x7f466415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f466415af50 0x7f466406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4664072b50 con 0x7f4664153610 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4664159520 con 0x7f46641539f0 2024-01-19T04:32:20.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.117+0000 7f4669891640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4664072940 con 0x7f466415af50 2024-01-19T04:32:20.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fc5e4c1a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5e0161a20 0x7fc5e015d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7ff4acf95640 1 Processor -- start 2024-01-19T04:32:20.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fc5e4c1a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e015de70 con 0x7fc5e0157cf0 2024-01-19T04:32:20.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fc5e4c1a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e01580d0 con 0x7fc5e00b1cf0 2024-01-19T04:32:20.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fc5e4c1a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e0161e00 con 0x7fc5e0161a20 2024-01-19T04:32:20.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 Processor -- start 2024-01-19T04:32:20.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 Processor -- start 2024-01-19T04:32:20.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7ff4acf95640 1 -- start start 2024-01-19T04:32:20.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 -- start start 2024-01-19T04:32:20.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 Processor -- start 2024-01-19T04:32:20.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 -- start start 2024-01-19T04:32:20.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fce53fff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fce4c046c50 0x7fce4c107280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:54598/0 (socket says 172.21.15.133:54598) 2024-01-19T04:32:20.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fce53fff640 1 -- 172.21.15.133:0/3451519194 learned_addr learned my addr 172.21.15.133:0/3451519194 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 -- start start 2024-01-19T04:32:20.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58e8151530 0x7f58e81571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58e806f7e0 0x7f58e80c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7ff4acf95640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4a8157380 0x7ff4a80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7ff4acf95640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a80c7500 con 0x7ff4a80c5db0 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7ff4acf95640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a8151b20 con 0x7ff4a8151740 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7ff4acf95640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a806f190 con 0x7ff4a8157380 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e8151910 con 0x7f58e806fc10 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e8158090 con 0x7f58e806f7e0 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f58e7fff640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e81577f0 con 0x7f58e8151530 2024-01-19T04:32:20.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdea8035ac0 0x7fdea80459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdea8033b70 0x7fdea8045f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea8006890 con 0x7fdea80356e0 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea8007fe0 con 0x7fdea8035ac0 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7fdeb552e640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea80062d0 con 0x7fdea8033b70 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ec40c69b0 0x7f4ec40c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ec40c6d90 0x7f4ec40c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40c16b0 con 0x7f4ec40c6d90 2024-01-19T04:32:20.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40c1970 con 0x7f4ec40c69b0 2024-01-19T04:32:20.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.121+0000 7f4ec9eee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4156450 con 0x7f4ec4156f30 2024-01-19T04:32:20.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.125+0000 7f58737fe640 1 -- 172.21.15.133:0/1952164317 >> v1:172.21.15.156:6789/0 conn(0x7f58740c0660 legacy=0x7f58741576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.125+0000 7f58737fe640 1 -- 172.21.15.133:0/1952164317 >> v1:172.21.15.133:6789/0 conn(0x7f58740c82b0 legacy=0x7f587406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.125+0000 7f58737fe640 1 -- 172.21.15.133:0/1952164317 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740c0ec0 con 0x7f58740c7ed0 2024-01-19T04:32:20.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.125+0000 7fce52ffd640 1 --2- 172.21.15.133:0/3451519194 >> v2:172.21.15.156:3300/0 conn(0x7fce4c045450 0x7fce4c0fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.129+0000 7f466888f640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4664153610 0x7f4664072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:54604/0 (socket says 172.21.15.133:54604) 2024-01-19T04:32:20.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.129+0000 7f466888f640 1 -- 172.21.15.133:0/125977229 learned_addr learned my addr 172.21.15.133:0/125977229 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.129+0000 7f4669090640 1 --2- 172.21.15.133:0/125977229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f466415af50 0x7f466406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.133+0000 7f58737fe640 1 --2- 172.21.15.133:0/1952164317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c7ed0 0x7f5874161b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f586c009dc0 tx=0x7f586c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c85af30a74b1613 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.133+0000 7f4663fff640 1 --2- 172.21.15.133:0/125977229 >> v2:172.21.15.133:3300/0 conn(0x7f46641539f0 0x7f466415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.133+0000 7fc5deffd640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc5e00b1cf0 0x7fc5e00cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:54616/0 (socket says 172.21.15.133:54616) 2024-01-19T04:32:20.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.133+0000 7fc5deffd640 1 -- 172.21.15.133:0/1533889340 learned_addr learned my addr 172.21.15.133:0/1533889340 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f58e67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58e806f7e0 0x7f58e80c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f4669090640 1 -- 172.21.15.133:0/125977229 >> v2:172.21.15.133:3300/0 conn(0x7f46641539f0 msgr2=0x7f466415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f4669090640 1 --2- 172.21.15.133:0/125977229 >> v2:172.21.15.133:3300/0 conn(0x7f46641539f0 0x7f466415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f4669090640 1 -- 172.21.15.133:0/125977229 >> v1:172.21.15.156:6789/0 conn(0x7f4664153610 legacy=0x7f4664072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f4669090640 1 -- 172.21.15.133:0/125977229 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664159710 con 0x7f466415af50 2024-01-19T04:32:20.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f58e67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58e806f7e0 0x7f58e80c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56356/0 (socket says 172.21.15.133:56356) 2024-01-19T04:32:20.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7f58e67fc640 1 -- 172.21.15.133:0/3661602926 learned_addr learned my addr 172.21.15.133:0/3661602926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.137+0000 7ff4a6d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4a8157380 0x7ff4a80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7ff4a659c640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff4a8151740 0x7ff4a806ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:54642/0 (socket says 172.21.15.133:54642) 2024-01-19T04:32:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7ff4a659c640 1 -- 172.21.15.133:0/1169200693 learned_addr learned my addr 172.21.15.133:0/1169200693 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7f58e67fc640 1 -- 172.21.15.133:0/3661602926 >> v2:172.21.15.156:3300/0 conn(0x7f58e8151530 msgr2=0x7f58e81571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7f58e67fc640 1 --2- 172.21.15.133:0/3661602926 >> v2:172.21.15.156:3300/0 conn(0x7f58e8151530 0x7f58e81571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7f58e67fc640 1 -- 172.21.15.133:0/3661602926 >> v1:172.21.15.156:6789/0 conn(0x7f58e806fc10 legacy=0x7f58e80c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7f58e67fc640 1 -- 172.21.15.133:0/3661602926 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8157ad0 con 0x7f58e806f7e0 2024-01-19T04:32:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7fce52ffd640 1 -- 172.21.15.133:0/3451519194 >> v1:172.21.15.156:6789/0 conn(0x7fce4c046c50 legacy=0x7fce4c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7fce52ffd640 1 -- 172.21.15.133:0/3451519194 >> v1:172.21.15.133:6789/0 conn(0x7fce4c0f6bc0 legacy=0x7fce4c04b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.141+0000 7fce52ffd640 1 -- 172.21.15.133:0/3451519194 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c045bb0 con 0x7fce4c045450 2024-01-19T04:32:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.145+0000 7ff4a6d9d640 1 -- 172.21.15.133:0/1169200693 >> v1:172.21.15.156:6789/0 conn(0x7ff4a8151740 legacy=0x7ff4a806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.145+0000 7ff4a6d9d640 1 -- 172.21.15.133:0/1169200693 >> v1:172.21.15.133:6789/0 conn(0x7ff4a80c5db0 legacy=0x7ff4a806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.145+0000 7ff4a6d9d640 1 -- 172.21.15.133:0/1169200693 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80c8d40 con 0x7ff4a8157380 2024-01-19T04:32:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.145+0000 7fc5dffff640 1 --2- 172.21.15.133:0/1533889340 >> v2:172.21.15.133:3300/0 conn(0x7fc5e0161a20 0x7fc5e015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.145+0000 7f58e67fc640 1 --2- 172.21.15.133:0/3661602926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e806f7e0 0x7f58e80c8790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58e8070200 tx=0x7f58e001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899bd0f282f9dcf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.145+0000 7f4ec3fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.149+0000 7f4669090640 1 --2- 172.21.15.133:0/125977229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f466415af50 0x7f466406a660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f46540097c0 tx=0x7f465401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ff6ffa4623f897 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.149+0000 7f4ec3fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:37984/0 (socket says 172.21.15.133:37984) 2024-01-19T04:32:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.149+0000 7f4ec3fff640 1 -- 172.21.15.133:0/1981987261 learned_addr learned my addr 172.21.15.133:0/1981987261 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.149+0000 7fce52ffd640 1 --2- 172.21.15.133:0/3451519194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c045450 0x7fce4c0fd380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce54050320 tx=0x7fce54089b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8c568aeeda49a4e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.153+0000 7fc5dffff640 1 -- 172.21.15.133:0/1533889340 >> v1:172.21.15.156:6789/0 conn(0x7fc5e00b1cf0 legacy=0x7fc5e00cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.153+0000 7fc5dffff640 1 -- 172.21.15.133:0/1533889340 >> v1:172.21.15.133:6789/0 conn(0x7fc5e0157cf0 legacy=0x7fc5e00c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.153+0000 7fc5dffff640 1 -- 172.21.15.133:0/1533889340 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00c79a0 con 0x7fc5e0161a20 2024-01-19T04:32:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e5ffb640 1 -- 172.21.15.133:0/3661602926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00af400 con 0x7f58e806f7e0 2024-01-19T04:32:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e5ffb640 1 -- 172.21.15.133:0/3661602926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e00ab050 con 0x7f58e806f7e0 2024-01-19T04:32:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e5ffb640 1 -- 172.21.15.133:0/3661602926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00af780 con 0x7f58e806f7e0 2024-01-19T04:32:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f4ec96ed640 1 --2- 172.21.15.133:0/1981987261 >> v2:172.21.15.133:3300/0 conn(0x7f4ec40c6d90 0x7f4ec40c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7fdeae7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdea8035ac0 0x7fdea80459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 -- 172.21.15.133:0/3661602926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e806f7e0 msgr2=0x7f58e80c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 --2- 172.21.15.133:0/3661602926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e806f7e0 0x7f58e80c8790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58e8070200 tx=0x7f58e001f180 comp rx=0 tx=0).stop 2024-01-19T04:32:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 -- 172.21.15.133:0/3661602926 shutdown_connections 2024-01-19T04:32:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 --2- 172.21.15.133:0/3661602926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e806f7e0 0x7f58e80c8790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 --2- 172.21.15.133:0/3661602926 >> v2:172.21.15.156:3300/0 conn(0x7f58e8151530 0x7f58e81571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 -- 172.21.15.133:0/3661602926 >> 172.21.15.133:0/3661602926 conn(0x7f58e8070db0 msgr2=0x7f58e80711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 -- 172.21.15.133:0/3661602926 shutdown_connections 2024-01-19T04:32:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f58e7fff640 1 -- 172.21.15.133:0/3661602926 wait complete. 2024-01-19T04:32:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f46637fe640 1 -- 172.21.15.133:0/125977229 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540a8970 con 0x7f466415af50 2024-01-19T04:32:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f46637fe640 1 -- 172.21.15.133:0/125977229 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46540a8ad0 con 0x7f466415af50 2024-01-19T04:32:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.157+0000 7f46637fe640 1 -- 172.21.15.133:0/125977229 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540a8e60 con 0x7f466415af50 2024-01-19T04:32:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 Processor -- start 2024-01-19T04:32:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 -- start start 2024-01-19T04:32:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7fdeae7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdea8035ac0 0x7fdea80459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56370/0 (socket says 172.21.15.133:56370) 2024-01-19T04:32:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7fdeae7fc640 1 -- 172.21.15.133:0/4072738116 learned_addr learned my addr 172.21.15.133:0/4072738116 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- 172.21.15.133:0/125977229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f466415af50 msgr2=0x7f466406a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 --2- 172.21.15.133:0/125977229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f466415af50 0x7f466406a660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f46540097c0 tx=0x7f465401ec70 comp rx=0 tx=0).stop 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- 172.21.15.133:0/125977229 shutdown_connections 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 --2- 172.21.15.133:0/125977229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f466415af50 0x7f466406a660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 --2- 172.21.15.133:0/125977229 >> v2:172.21.15.133:3300/0 conn(0x7f46641539f0 0x7f466415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- 172.21.15.133:0/125977229 >> 172.21.15.133:0/125977229 conn(0x7f466406d490 msgr2=0x7f466406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- 172.21.15.133:0/125977229 shutdown_connections 2024-01-19T04:32:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- 172.21.15.133:0/125977229 wait complete. 2024-01-19T04:32:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e806f7e0 0x7f58e80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e806fc10 0x7f58e814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e8151530 0x7f58e814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e806cc90 con 0x7f58e8151530 2024-01-19T04:32:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e81f38e0 con 0x7f58e806f7e0 2024-01-19T04:32:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f58e7fff640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e81f29f0 con 0x7f58e806fc10 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 Processor -- start 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- start start 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4664153610 0x7f4664150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46641539f0 0x7f46641e2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466415af50 0x7f46641550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46641e6430 con 0x7f4664153610 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46641e6610 con 0x7f466415af50 2024-01-19T04:32:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.161+0000 7f4669891640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4664153eb0 con 0x7f46641539f0 2024-01-19T04:32:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce527fc640 1 -- 172.21.15.133:0/3451519194 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce541138f0 con 0x7fce4c045450 2024-01-19T04:32:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce527fc640 1 -- 172.21.15.133:0/3451519194 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54113a50 con 0x7fce4c045450 2024-01-19T04:32:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce527fc640 1 -- 172.21.15.133:0/3451519194 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54113e80 con 0x7fce4c045450 2024-01-19T04:32:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- 172.21.15.133:0/3451519194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c045450 msgr2=0x7fce4c0fd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 --2- 172.21.15.133:0/3451519194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c045450 0x7fce4c0fd380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce54050320 tx=0x7fce54089b40 comp rx=0 tx=0).stop 2024-01-19T04:32:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- 172.21.15.133:0/3451519194 shutdown_connections 2024-01-19T04:32:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 --2- 172.21.15.133:0/3451519194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c045450 0x7fce4c0fd380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- 172.21.15.133:0/3451519194 >> 172.21.15.133:0/3451519194 conn(0x7fce4c050190 msgr2=0x7fce4c0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fdeae7fc640 1 -- 172.21.15.133:0/4072738116 >> v2:172.21.15.156:3300/0 conn(0x7fdea8033b70 msgr2=0x7fdea8045f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fdeae7fc640 1 --2- 172.21.15.133:0/4072738116 >> v2:172.21.15.156:3300/0 conn(0x7fdea8033b70 0x7fdea8045f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fdeae7fc640 1 -- 172.21.15.133:0/4072738116 >> v1:172.21.15.133:6789/0 conn(0x7fdea80356e0 legacy=0x7fdea80d5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fdeae7fc640 1 -- 172.21.15.133:0/4072738116 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80065b0 con 0x7fdea8035ac0 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- 172.21.15.133:0/3451519194 shutdown_connections 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- 172.21.15.133:0/3451519194 wait complete. 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 Processor -- start 2024-01-19T04:32:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- start start 2024-01-19T04:32:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c045450 0x7fce4c0e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c046c50 0x7fce4c0e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c0f6bc0 0x7fce4c034d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0e57e0 con 0x7fce4c045450 2024-01-19T04:32:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0f9810 con 0x7fce4c0f6bc0 2024-01-19T04:32:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.165+0000 7fce58934640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0fa260 con 0x7fce4c046c50 2024-01-19T04:32:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.169+0000 7f4ec3fff640 1 -- 172.21.15.133:0/1981987261 >> v2:172.21.15.156:3300/0 conn(0x7f4ec40c69b0 msgr2=0x7f4ec40c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.169+0000 7f4ec3fff640 1 --2- 172.21.15.133:0/1981987261 >> v2:172.21.15.156:3300/0 conn(0x7f4ec40c69b0 0x7f4ec40c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.169+0000 7f4ec3fff640 1 -- 172.21.15.133:0/1981987261 >> v2:172.21.15.133:3300/0 conn(0x7f4ec40c6d90 msgr2=0x7f4ec40c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.169+0000 7f4ec3fff640 1 --2- 172.21.15.133:0/1981987261 >> v2:172.21.15.133:3300/0 conn(0x7f4ec40c6d90 0x7f4ec40c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.169+0000 7f4ec3fff640 1 -- 172.21.15.133:0/1981987261 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4156730 con 0x7f4ec4156f30 2024-01-19T04:32:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.173+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e8151530 0x7f58e814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.173+0000 7f4ec3fff640 1 --2- 172.21.15.133:0/1981987261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4159880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4070610 tx=0x7f4eb4020f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ace3171430ca9e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.173+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e8151530 0x7f58e814a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56398/0 (socket says 172.21.15.133:56398) 2024-01-19T04:32:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.173+0000 7f58e77fe640 1 -- 172.21.15.133:0/3399987474 learned_addr learned my addr 172.21.15.133:0/3399987474 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.177+0000 7fc5dffff640 1 --2- 172.21.15.133:0/1533889340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0161a20 0x7fc5e015d930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009d90 tx=0x7fc5d801f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a443094dcaaf2e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.177+0000 7ff4a6d9d640 1 --2- 172.21.15.133:0/1169200693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8157380 0x7ff4a80c7990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009d90 tx=0x7ff4a001f0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895d15cdd712ce58 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.181+0000 7f58e77fe640 1 -- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e806fc10 msgr2=0x7f58e814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.181+0000 7f58e77fe640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e806fc10 0x7f58e814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.181+0000 7f58e77fe640 1 -- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e806f7e0 msgr2=0x7f58e80c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.181+0000 7f58e77fe640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e806f7e0 0x7f58e80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.181+0000 7f58e77fe640 1 -- 172.21.15.133:0/3399987474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0009b30 con 0x7f58e8151530 2024-01-19T04:32:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f58727fc640 1 -- 172.21.15.133:0/1952164317 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0a59e0 con 0x7f58740c7ed0 2024-01-19T04:32:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f58727fc640 1 -- 172.21.15.133:0/1952164317 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0a5b40 con 0x7f58740c7ed0 2024-01-19T04:32:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f58727fc640 1 -- 172.21.15.133:0/1952164317 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0ad440 con 0x7f58740c7ed0 2024-01-19T04:32:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 -- 172.21.15.133:0/1952164317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c7ed0 msgr2=0x7f5874161b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 --2- 172.21.15.133:0/1952164317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c7ed0 0x7f5874161b00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f586c009dc0 tx=0x7f586c01c920 comp rx=0 tx=0).stop 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 -- 172.21.15.133:0/1952164317 shutdown_connections 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 --2- 172.21.15.133:0/1952164317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c7ed0 0x7f5874161b00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 -- 172.21.15.133:0/1952164317 >> 172.21.15.133:0/1952164317 conn(0x7f587406aa60 msgr2=0x7f587406ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 -- 172.21.15.133:0/1952164317 shutdown_connections 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 -- 172.21.15.133:0/1952164317 wait complete. 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7fce52ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c046c50 0x7fce4c0e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7fce537fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c045450 0x7fce4c0e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7fce52ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c046c50 0x7fce4c0e82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:38020/0 (socket says 172.21.15.133:38020) 2024-01-19T04:32:20.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7fce52ffd640 1 -- 172.21.15.133:0/1336357833 learned_addr learned my addr 172.21.15.133:0/1336357833 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f58e77fe640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e8151530 0x7f58e814a550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c440 tx=0x7f58dc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 Processor -- start 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.189+0000 7f5879e53640 1 -- start start 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f5879e53640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c0660 0x7f58740c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f5879e53640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58740c7ed0 0x7f58741529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f5879e53640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58740c82b0 0x7f58740ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f5879e53640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741fa6c0 con 0x7f58740c82b0 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f5879e53640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587415fd60 con 0x7f58740c7ed0 2024-01-19T04:32:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f5879e53640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587415ff90 con 0x7f58740c0660 2024-01-19T04:32:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4a559a640 1 -- 172.21.15.133:0/1169200693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00b0440 con 0x7ff4a8157380 2024-01-19T04:32:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4a559a640 1 -- 172.21.15.133:0/1169200693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a00b05a0 con 0x7ff4a8157380 2024-01-19T04:32:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4a559a640 1 -- 172.21.15.133:0/1169200693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00b0930 con 0x7ff4a8157380 2024-01-19T04:32:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7f466888f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4664153610 0x7f4664150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 -- 172.21.15.133:0/1169200693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8157380 msgr2=0x7ff4a80c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 --2- 172.21.15.133:0/1169200693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8157380 0x7ff4a80c7990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009d90 tx=0x7ff4a001f0c0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 -- 172.21.15.133:0/1169200693 shutdown_connections 2024-01-19T04:32:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 --2- 172.21.15.133:0/1169200693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8157380 0x7ff4a80c7990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 -- 172.21.15.133:0/1169200693 >> 172.21.15.133:0/1169200693 conn(0x7ff4a806b770 msgr2=0x7ff4a806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 -- 172.21.15.133:0/1169200693 shutdown_connections 2024-01-19T04:32:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 -- 172.21.15.133:0/1169200693 wait complete. 2024-01-19T04:32:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 Processor -- start 2024-01-19T04:32:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.193+0000 7ff4acf95640 1 -- start start 2024-01-19T04:32:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7ff4acf95640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4a80c5db0 0x7ff4a81502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7ff4acf95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8151740 0x7ff4a81445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7ff4acf95640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4a8157380 0x7ff4a81f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7ff4acf95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8144ed0 con 0x7ff4a8151740 2024-01-19T04:32:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7ff4acf95640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80cbc20 con 0x7ff4a80c5db0 2024-01-19T04:32:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7ff4acf95640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a81f08a0 con 0x7ff4a8157380 2024-01-19T04:32:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7fce52ffd640 1 -- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c0f6bc0 msgr2=0x7fce4c034d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7fce52ffd640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c0f6bc0 0x7fce4c034d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7fce52ffd640 1 -- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c045450 msgr2=0x7fce4c0e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7fce52ffd640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c045450 0x7fce4c0e7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.197+0000 7fce52ffd640 1 -- 172.21.15.133:0/1336357833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0f9d00 con 0x7fce4c046c50 2024-01-19T04:32:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.201+0000 7f466888f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4664153610 0x7f4664150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56408/0 (socket says 172.21.15.133:56408) 2024-01-19T04:32:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.201+0000 7f466888f640 1 -- 172.21.15.133:0/1948486192 learned_addr learned my addr 172.21.15.133:0/1948486192 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.201+0000 7f5872ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58740c7ed0 0x7f58741529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f4669090640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466415af50 0x7f46641550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f4663fff640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46641539f0 0x7f46641e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f466888f640 1 -- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46641539f0 msgr2=0x7f46641e2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f466888f640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46641539f0 0x7f46641e2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f466888f640 1 -- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466415af50 msgr2=0x7f46641550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f466888f640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466415af50 0x7f46641550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f466888f640 1 -- 172.21.15.133:0/1948486192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654009420 con 0x7f4664153610 2024-01-19T04:32:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7ff4a659c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4a80c5db0 0x7ff4a81502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f5872ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58740c7ed0 0x7f58741529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44556/0 (socket says 172.21.15.133:44556) 2024-01-19T04:32:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.205+0000 7f5872ffd640 1 -- 172.21.15.133:0/3316579046 learned_addr learned my addr 172.21.15.133:0/3316579046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5de7fc640 1 -- 172.21.15.133:0/1533889340 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80af600 con 0x7fc5e0161a20 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5de7fc640 1 -- 172.21.15.133:0/1533889340 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d80ab050 con 0x7fc5e0161a20 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5de7fc640 1 -- 172.21.15.133:0/1533889340 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80af980 con 0x7fc5e0161a20 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/1533889340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0161a20 msgr2=0x7fc5e015d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 --2- 172.21.15.133:0/1533889340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0161a20 0x7fc5e015d930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009d90 tx=0x7fc5d801f100 comp rx=0 tx=0).stop 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/1533889340 shutdown_connections 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 --2- 172.21.15.133:0/1533889340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0161a20 0x7fc5e015d930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/1533889340 >> 172.21.15.133:0/1533889340 conn(0x7fc5e0066b70 msgr2=0x7fc5e006fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/1533889340 shutdown_connections 2024-01-19T04:32:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/1533889340 wait complete. 2024-01-19T04:32:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7ff4a659c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4a80c5db0 0x7ff4a81502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44570/0 (socket says 172.21.15.133:44570) 2024-01-19T04:32:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7ff4a659c640 1 -- 172.21.15.133:0/3717857827 learned_addr learned my addr 172.21.15.133:0/3717857827 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fdeae7fc640 1 --2- 172.21.15.133:0/4072738116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 0x7fdea80459e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e850 tx=0x7fdea401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b89fefe5360b170 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7f466888f640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4664153610 0x7f4664150b80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f465800c500 tx=0x7f465800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 Processor -- start 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- start start 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5e00b1cf0 0x7fc5e014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0157cf0 0x7fc5e014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5e0161a20 0x7fc5e01f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e015d2e0 con 0x7fc5e0157cf0 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e015bc40 con 0x7fc5e00b1cf0 2024-01-19T04:32:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fc5e4c1a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0151590 con 0x7fc5e0161a20 2024-01-19T04:32:20.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.209+0000 7fce52ffd640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c046c50 0x7fce4c0e82b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce54068710 tx=0x7fce54069b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec37fe640 1 -- 172.21.15.133:0/1981987261 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40aabc0 con 0x7f4ec4156f30 2024-01-19T04:32:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec37fe640 1 -- 172.21.15.133:0/1981987261 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40aad20 con 0x7f4ec4156f30 2024-01-19T04:32:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec37fe640 1 -- 172.21.15.133:0/1981987261 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40b2660 con 0x7f4ec4156f30 2024-01-19T04:32:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 -- 172.21.15.133:0/1981987261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 msgr2=0x7f4ec4159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/1981987261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4159880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4070610 tx=0x7f4eb4020f00 comp rx=0 tx=0).stop 2024-01-19T04:32:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 -- 172.21.15.133:0/1981987261 shutdown_connections 2024-01-19T04:32:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/1981987261 >> v2:172.21.15.133:3300/0 conn(0x7f4ec40c6d90 0x7f4ec40c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/1981987261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4159880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/1981987261 >> v2:172.21.15.156:3300/0 conn(0x7f4ec40c69b0 0x7f4ec40c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 -- 172.21.15.133:0/1981987261 >> 172.21.15.133:0/1981987261 conn(0x7f4ec4066b70 msgr2=0x7f4ec406fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 -- 172.21.15.133:0/1981987261 shutdown_connections 2024-01-19T04:32:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 -- 172.21.15.133:0/1981987261 wait complete. 2024-01-19T04:32:20.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 Processor -- start 2024-01-19T04:32:20.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.213+0000 7f4ec9eee640 1 -- start start 2024-01-19T04:32:20.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4ec9eee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec40c69b0 0x7f4ec41541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4ec9eee640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec40c6d90 0x7f4ec41eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4ec9eee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4ec9eee640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41edfd0 con 0x7f4ec40c69b0 2024-01-19T04:32:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4ec9eee640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41ee830 con 0x7f4ec40c6d90 2024-01-19T04:32:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4ec9eee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41548a0 con 0x7f4ec4156f30 2024-01-19T04:32:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc003600 con 0x7f58e8151530 2024-01-19T04:32:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc003780 con 0x7f58e8151530 2024-01-19T04:32:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc003b30 con 0x7f58e8151530 2024-01-19T04:32:20.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e81f2cd0 con 0x7f58e8151530 2024-01-19T04:32:20.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f5873fff640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58740c82b0 0x7f58740ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e81f3290 con 0x7f58e8151530 2024-01-19T04:32:20.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58e806f2c0 con 0x7f58e8151530 2024-01-19T04:32:20.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658005cf0 con 0x7f4664153610 2024-01-19T04:32:20.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4658005e50 con 0x7f4664153610 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4664154190 con 0x7f4664153610 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580072f0 con 0x7f4664153610 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46641510c0 con 0x7f4664153610 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.217+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4664152db0 con 0x7f4664153610 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.221+0000 7f5872ffd640 1 -- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c0660 msgr2=0x7f58740c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.221+0000 7f5872ffd640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58740c0660 0x7f58740c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.221+0000 7f5872ffd640 1 -- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58740c82b0 msgr2=0x7f58740ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.221+0000 7f5872ffd640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58740c82b0 0x7f58740ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.221+0000 7f5872ffd640 1 -- 172.21.15.133:0/3316579046 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c009a70 con 0x7f58740c7ed0 2024-01-19T04:32:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeadffb640 1 -- 172.21.15.133:0/4072738116 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40ab600 con 0x7fdea8035ac0 2024-01-19T04:32:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeadffb640 1 -- 172.21.15.133:0/4072738116 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea40a7050 con 0x7fdea8035ac0 2024-01-19T04:32:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeadffb640 1 -- 172.21.15.133:0/4072738116 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40ab980 con 0x7fdea8035ac0 2024-01-19T04:32:20.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7ff4a659c640 1 -- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4a8157380 msgr2=0x7ff4a81f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7ff4a659c640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4a8157380 0x7ff4a81f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7ff4a659c640 1 -- 172.21.15.133:0/3717857827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8151740 msgr2=0x7ff4a81445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7ff4a659c640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a8151740 0x7ff4a81445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7ff4a659c640 1 -- 172.21.15.133:0/3717857827 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a0009a70 con 0x7ff4a80c5db0 2024-01-19T04:32:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 -- 172.21.15.133:0/4072738116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 msgr2=0x7fdea80459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 --2- 172.21.15.133:0/4072738116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 0x7fdea80459e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e850 tx=0x7fdea401c4e0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 -- 172.21.15.133:0/4072738116 shutdown_connections 2024-01-19T04:32:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 --2- 172.21.15.133:0/4072738116 >> v2:172.21.15.156:3300/0 conn(0x7fdea8033b70 0x7fdea8045f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 --2- 172.21.15.133:0/4072738116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 0x7fdea80459e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 -- 172.21.15.133:0/4072738116 >> 172.21.15.133:0/4072738116 conn(0x7fdea804d4c0 msgr2=0x7fdea804d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 -- 172.21.15.133:0/4072738116 shutdown_connections 2024-01-19T04:32:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 -- 172.21.15.133:0/4072738116 wait complete. 2024-01-19T04:32:20.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5411ba90 con 0x7fce4c046c50 2024-01-19T04:32:20.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5411bbf0 con 0x7fce4c046c50 2024-01-19T04:32:20.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54126470 con 0x7fce4c046c50 2024-01-19T04:32:20.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c0f8a70 con 0x7fce4c046c50 2024-01-19T04:32:20.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 Processor -- start 2024-01-19T04:32:20.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c034510 con 0x7fce4c046c50 2024-01-19T04:32:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.229+0000 7fdeb552e640 1 -- start start 2024-01-19T04:32:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fdeb552e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea8033b70 0x7fdea80d8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fdeb552e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea80356e0 0x7fdea804fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fdeb552e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 0x7fdea8177770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fdeb552e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea817ace0 con 0x7fdea8035ac0 2024-01-19T04:32:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fdeb552e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80cb840 con 0x7fdea8033b70 2024-01-19T04:32:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fdeb552e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea817af30 con 0x7fdea80356e0 2024-01-19T04:32:20.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.233+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce4c046450 con 0x7fce4c046c50 2024-01-19T04:32:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.237+0000 7f5872ffd640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58740c7ed0 0x7f58741529f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f586400b3e0 tx=0x7f586400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.241+0000 7ff4a659c640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4a80c5db0 0x7ff4a81502b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c470 tx=0x7ff49800c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.241+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4658007450 con 0x7f4664153610 2024-01-19T04:32:20.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.241+0000 7f46617fa640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4650066500 0x7f46500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.241+0000 7f4663fff640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4650066500 0x7f46500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.241+0000 7f4663fff640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4650066500 0x7f46500689c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4664151820 tx=0x7f465c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4658054b70 con 0x7f4664153610 2024-01-19T04:32:20.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f4ec8eec640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec40c69b0 0x7f4ec41541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f46617fa640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f465006fa40 0x7f4650071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 --> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4650072550 con 0x7f465006fa40 2024-01-19T04:32:20.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4658050eb0 con 0x7f4664153610 2024-01-19T04:32:20.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f4669090640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f465006fa40 0x7f4650071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.253+0000 7f4669090640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f465006fa40 0x7f4650071e80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.257 INFO:tasks.ceph.mds.e.smithi133.stderr:2024-01-19T04:32:20.253+0000 f9d6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-01-19T04:32:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.257+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== osd.0 v2:172.21.15.133:6800/1465777875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4650072550 con 0x7f465006fa40 2024-01-19T04:32:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.257+0000 7f4ec8eec640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec40c69b0 0x7f4ec41541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56466/0 (socket says 172.21.15.133:56466) 2024-01-19T04:32:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.257+0000 7f4ec8eec640 1 -- 172.21.15.133:0/4079599052 learned_addr learned my addr 172.21.15.133:0/4079599052 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.261+0000 7f4ec8eec640 1 -- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 msgr2=0x7f4ec4146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.261+0000 7f4ec8eec640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ec4156f30 0x7f4ec4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.261+0000 7f4ec8eec640 1 -- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec40c6d90 msgr2=0x7f4ec41eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.261+0000 7f4ec8eec640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ec40c6d90 0x7f4ec41eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.261+0000 7f4ec8eec640 1 -- 172.21.15.133:0/4079599052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40094d0 con 0x7f4ec40c69b0 2024-01-19T04:32:20.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.273+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fce54122070 con 0x7fce4c046c50 2024-01-19T04:32:20.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.273+0000 7fce3ffff640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fce38066500 0x7fce380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.273+0000 7fce537fe640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fce38066500 0x7fce380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.273+0000 7fce537fe640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fce38066500 0x7fce380689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce480098e0 tx=0x7fce48009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.273+0000 7fc5df7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5e00b1cf0 0x7fc5e014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.277+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce5415ddc0 con 0x7fce4c046c50 2024-01-19T04:32:20.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.277+0000 7fce3ffff640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7fce3806f9c0 0x7fce38071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.277+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 --> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce380724d0 con 0x7fce3806f9c0 2024-01-19T04:32:20.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.277+0000 7fce53fff640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7fce3806f9c0 0x7fce38071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.277+0000 7fce53fff640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7fce3806f9c0 0x7fce38071e00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== osd.3 v2:172.21.15.133:6824/2044063014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fce380724d0 con 0x7fce3806f9c0 2024-01-19T04:32:20.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 --> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4664159cb0 con 0x7f465006fa40 2024-01-19T04:32:20.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f46617fa640 1 -- 172.21.15.133:0/1948486192 <== osd.0 v2:172.21.15.133:6800/1465777875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46540a8950 con 0x7f465006fa40 2024-01-19T04:32:20.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7fc5dffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5e0161a20 0x7fc5e01f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f465006fa40 msgr2=0x7f4650071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f465006fa40 0x7f4650071e80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4650066500 msgr2=0x7f46500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4650066500 0x7f46500689c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4664151820 tx=0x7f465c00b040 comp rx=0 tx=0).stop 2024-01-19T04:32:20.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4664153610 msgr2=0x7f4664150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 --2- 172.21.15.133:0/1948486192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4664153610 0x7f4664150b80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f465800c500 tx=0x7f465800c9c0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669090640 1 -- 172.21.15.133:0/1948486192 reap_dead start 2024-01-19T04:32:20.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 shutdown_connections 2024-01-19T04:32:20.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 >> 172.21.15.133:0/1948486192 conn(0x7f466406d490 msgr2=0x7f466406a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 shutdown_connections 2024-01-19T04:32:20.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7f4669891640 1 -- 172.21.15.133:0/1948486192 wait complete. 2024-01-19T04:32:20.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7fc5dffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5e0161a20 0x7fc5e01f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:38052/0 (socket says 172.21.15.133:38052) 2024-01-19T04:32:20.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7fc5dffff640 1 -- 172.21.15.133:0/3592717838 learned_addr learned my addr 172.21.15.133:0/3592717838 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498005cf0 con 0x7ff4a80c5db0 2024-01-19T04:32:20.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498005e50 con 0x7ff4a80c5db0 2024-01-19T04:32:20.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a814d760 con 0x7ff4a80c5db0 2024-01-19T04:32:20.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980072b0 con 0x7ff4a80c5db0 2024-01-19T04:32:20.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a80cb660 con 0x7ff4a80c5db0 2024-01-19T04:32:20.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.281+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4a80c9300 con 0x7ff4a80c5db0 2024-01-19T04:32:20.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f58dc003c90 con 0x7f58e8151530 2024-01-19T04:32:20.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7f58cf7fe640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58d4066500 0x7f58d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7f58e6ffd640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58d4066500 0x7f58d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7f58e6ffd640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58d4066500 0x7f58d40689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009690 tx=0x7f58d8006c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7fc5dffff640 1 -- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5e00b1cf0 msgr2=0x7fc5e014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7fc5dffff640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5e00b1cf0 0x7fc5e014ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7fc5dffff640 1 -- 172.21.15.133:0/3592717838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0157cf0 msgr2=0x7fc5e014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7fc5dffff640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e0157cf0 0x7fc5e014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.285+0000 7fc5dffff640 1 -- 172.21.15.133:0/3592717838 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009a70 con 0x7fc5e0161a20 2024-01-19T04:32:20.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.289+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58dc054b60 con 0x7f58e8151530 2024-01-19T04:32:20.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7f58cf7fe640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7f58d406fa40 0x7f58d4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 --> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58d4072550 con 0x7f58d406fa40 2024-01-19T04:32:20.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58dc0507a0 con 0x7f58e8151530 2024-01-19T04:32:20.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7f58e67fc640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7f58d406fa40 0x7f58d4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7f58e67fc640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7f58d406fa40 0x7f58d4071e80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7fc5dffff640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5e0161a20 0x7fc5e01f6a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5d801cd30 tx=0x7fc5d801bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== osd.6 v2:172.21.15.156:6819/2521997623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f58d4072550 con 0x7f58d406fa40 2024-01-19T04:32:20.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.293+0000 7fdeae7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea80356e0 0x7fdea804fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.297+0000 7fdeae7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea80356e0 0x7fdea804fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:38066/0 (socket says 172.21.15.133:38066) 2024-01-19T04:32:20.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.297+0000 7fdeae7fc640 1 -- 172.21.15.133:0/620426809 learned_addr learned my addr 172.21.15.133:0/620426809 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.297+0000 7f4ec8eec640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec40c69b0 0x7f4ec41541f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00ba50 tx=0x7f4ebc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.301 INFO:teuthology.orchestra.run.smithi133.stdout:60129542166 2024-01-19T04:32:20.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-19T04:32:20.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 --> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce4c0f7d10 con 0x7fce3806f9c0 2024-01-19T04:32:20.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce3ffff640 1 -- 172.21.15.133:0/1336357833 <== osd.3 v2:172.21.15.133:6824/2044063014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce4c0f7d10 con 0x7fce3806f9c0 2024-01-19T04:32:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7fce3806f9c0 msgr2=0x7fce38071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7fce3806f9c0 0x7fce38071e00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fce38066500 msgr2=0x7fce380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fce38066500 0x7fce380689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce480098e0 tx=0x7fce48009060 comp rx=0 tx=0).stop 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c046c50 msgr2=0x7fce4c0e82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 --2- 172.21.15.133:0/1336357833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c046c50 0x7fce4c0e82b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce54068710 tx=0x7fce54069b30 comp rx=0 tx=0).stop 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce53fff640 1 -- 172.21.15.133:0/1336357833 reap_dead start 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 shutdown_connections 2024-01-19T04:32:20.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 >> 172.21.15.133:0/1336357833 conn(0x7fce4c050190 msgr2=0x7fce4c04f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 shutdown_connections 2024-01-19T04:32:20.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.301+0000 7fce58934640 1 -- 172.21.15.133:0/1336357833 wait complete. 2024-01-19T04:32:20.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.305+0000 7fdeaf7fe640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 0x7fdea8177770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.305+0000 7fdeae7fc640 1 -- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea8033b70 msgr2=0x7fdea80d8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.305+0000 7fdeae7fc640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea8033b70 0x7fdea80d8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.305+0000 7fdeae7fc640 1 -- 172.21.15.133:0/620426809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 msgr2=0x7fdea8177770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.305+0000 7fdeae7fc640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea8035ac0 0x7fdea8177770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.305+0000 7fdeae7fc640 1 -- 172.21.15.133:0/620426809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40094d0 con 0x7fdea80356e0 2024-01-19T04:32:20.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.309+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00cbe0 con 0x7f4ec40c69b0 2024-01-19T04:32:20.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.309+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc00cd60 con 0x7f4ec40c69b0 2024-01-19T04:32:20.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.309+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec4154b80 con 0x7f4ec40c69b0 2024-01-19T04:32:20.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.309+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec41ee4c0 con 0x7f4ec40c69b0 2024-01-19T04:32:20.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.309+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc014680 con 0x7f4ec40c69b0 2024-01-19T04:32:20.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ec4159dc0 con 0x7f4ec40c69b0 2024-01-19T04:32:20.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 --> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58e806efe0 con 0x7f58d406fa40 2024-01-19T04:32:20.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58cf7fe640 1 -- 172.21.15.133:0/3399987474 <== osd.6 v2:172.21.15.156:6819/2521997623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58e00af400 con 0x7f58d406fa40 2024-01-19T04:32:20.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7f58d406fa40 msgr2=0x7f58d4071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7f58d406fa40 0x7f58d4071e80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58d4066500 msgr2=0x7f58d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58d4066500 0x7f58d40689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009690 tx=0x7f58d8006c00 comp rx=0 tx=0).stop 2024-01-19T04:32:20.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e8151530 msgr2=0x7f58e814a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 --2- 172.21.15.133:0/3399987474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e8151530 0x7f58e814a550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c440 tx=0x7f58dc00c900 comp rx=0 tx=0).stop 2024-01-19T04:32:20.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e77fe640 1 -- 172.21.15.133:0/3399987474 reap_dead start 2024-01-19T04:32:20.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 shutdown_connections 2024-01-19T04:32:20.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 >> 172.21.15.133:0/3399987474 conn(0x7f58e8070db0 msgr2=0x7f58e814ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 shutdown_connections 2024-01-19T04:32:20.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.313+0000 7f58e7fff640 1 -- 172.21.15.133:0/3399987474 wait complete. 2024-01-19T04:32:20.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80ba480 con 0x7fc5e0161a20 2024-01-19T04:32:20.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d80ba5e0 con 0x7fc5e0161a20 2024-01-19T04:32:20.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80ba970 con 0x7fc5e0161a20 2024-01-19T04:32:20.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e015c9d0 con 0x7fc5e0161a20 2024-01-19T04:32:20.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e015cc90 con 0x7fc5e0161a20 2024-01-19T04:32:20.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5e0161220 con 0x7fc5e0161a20 2024-01-19T04:32:20.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.317+0000 7fdeae7fc640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea80356e0 0x7fdea804fc00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdea401ab90 tx=0x7fdea4019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.324 INFO:teuthology.orchestra.run.smithi133.stdout:64424509463 2024-01-19T04:32:20.324 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-19T04:32:20.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff498007410 con 0x7ff4a80c5db0 2024-01-19T04:32:20.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7ff496ffd640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff488066550 0x7ff488068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864011830 con 0x7f58740c7ed0 2024-01-19T04:32:20.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864011990 con 0x7f58740c7ed0 2024-01-19T04:32:20.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7f5879e53640 1 -- 172.21.15.133:0/3316579046 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5874160250 con 0x7f58740c7ed0 2024-01-19T04:32:20.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864011d60 con 0x7f58740c7ed0 2024-01-19T04:32:20.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7f5879e53640 1 -- 172.21.15.133:0/3316579046 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874160810 con 0x7f58740c7ed0 2024-01-19T04:32:20.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7ff4a5d9b640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff488066550 0x7ff488068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7ff4a5d9b640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff488066550 0x7ff488068a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007fd0 tx=0x7ff49c0079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.329+0000 7f5879e53640 1 -- 172.21.15.133:0/3316579046 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f587416baf0 con 0x7f58740c7ed0 2024-01-19T04:32:20.335 INFO:teuthology.orchestra.run.smithi133.stdout:64424509463 2024-01-19T04:32:20.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-19T04:32:20.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.337+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff498019300 con 0x7ff4a80c5db0 2024-01-19T04:32:20.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.337+0000 7ff496ffd640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7ff48806fa90 0x7ff488071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.337+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 --> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4880725a0 con 0x7ff48806fa90 2024-01-19T04:32:20.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.337+0000 7ff4a6d9d640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7ff48806fa90 0x7ff488071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.337+0000 7ff4a6d9d640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7ff48806fa90 0x7ff488071ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.337+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== osd.4 v2:172.21.15.156:6810/3494223144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff4880725a0 con 0x7ff48806fa90 2024-01-19T04:32:20.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.349+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4ebc007370 con 0x7f4ec40c69b0 2024-01-19T04:32:20.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.349+0000 7f4ec17fa640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4eb0066500 0x7f4eb00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.349+0000 7f4ec3fff640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4eb0066500 0x7f4eb00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.349+0000 7f4ec3fff640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4eb0066500 0x7f4eb00689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40b4000 tx=0x7f4eb4004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.353+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ebc055c00 con 0x7f4ec40c69b0 2024-01-19T04:32:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.353+0000 7f4ec17fa640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f4eb006fa40 0x7f4eb0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.353+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 --> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4eb0072550 con 0x7f4eb006fa40 2024-01-19T04:32:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.353+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ebc051840 con 0x7f4ec40c69b0 2024-01-19T04:32:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.353+0000 7f4ec96ed640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f4eb006fa40 0x7f4eb0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.357+0000 7f4ec96ed640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f4eb006fa40 0x7f4eb0071e80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.357+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== osd.1 v2:172.21.15.133:6816/2799296662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4eb0072550 con 0x7f4eb006fa40 2024-01-19T04:32:20.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 --> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4a80c7ed0 con 0x7ff48806fa90 2024-01-19T04:32:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff496ffd640 1 -- 172.21.15.133:0/3717857827 <== osd.4 v2:172.21.15.156:6810/3494223144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4a00b0790 con 0x7ff48806fa90 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7ff48806fa90 msgr2=0x7ff488071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7ff48806fa90 0x7ff488071ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff488066550 msgr2=0x7ff488068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff488066550 0x7ff488068a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007fd0 tx=0x7ff49c0079a0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4a80c5db0 msgr2=0x7ff4a81502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4acf95640 1 --2- 172.21.15.133:0/3717857827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4a80c5db0 0x7ff4a81502b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c470 tx=0x7ff49800c930 comp rx=0 tx=0).stop 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.369+0000 7ff4a6d9d640 1 -- 172.21.15.133:0/3717857827 reap_dead start 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.373+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 shutdown_connections 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.373+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 >> 172.21.15.133:0/3717857827 conn(0x7ff4a806b770 msgr2=0x7ff4a814cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.373+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 shutdown_connections 2024-01-19T04:32:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.373+0000 7ff4acf95640 1 -- 172.21.15.133:0/3717857827 wait complete. 2024-01-19T04:32:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.381+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc5d80b6040 con 0x7fc5e0161a20 2024-01-19T04:32:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.381+0000 7fc5c7fff640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc5cc066580 0x7fc5cc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.381+0000 7fc5df7fe640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc5cc066580 0x7fc5cc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7fc5df7fe640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc5cc066580 0x7fc5cc068a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00016c0 tx=0x7fc5d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 --> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ec40c13d0 con 0x7f4eb006fa40 2024-01-19T04:32:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec17fa640 1 -- 172.21.15.133:0/4079599052 <== osd.1 v2:172.21.15.133:6816/2799296662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4eb80096e0 con 0x7f4eb006fa40 2024-01-19T04:32:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f4eb006fa40 msgr2=0x7f4eb0071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f4eb006fa40 0x7f4eb0071e80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4eb0066500 msgr2=0x7f4eb00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4eb0066500 0x7f4eb00689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40b4000 tx=0x7f4eb4004740 comp rx=0 tx=0).stop 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec40c69b0 msgr2=0x7f4ec41541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 --2- 172.21.15.133:0/4079599052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec40c69b0 0x7f4ec41541f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00ba50 tx=0x7f4ebc00bf10 comp rx=0 tx=0).stop 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec96ed640 1 -- 172.21.15.133:0/4079599052 reap_dead start 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 shutdown_connections 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 >> 172.21.15.133:0/4079599052 conn(0x7f4ec4066b70 msgr2=0x7f4ec40c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 shutdown_connections 2024-01-19T04:32:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.385+0000 7f4ec9eee640 1 -- 172.21.15.133:0/4079599052 wait complete. 2024-01-19T04:32:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.389+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5d80f4a50 con 0x7fc5e0161a20 2024-01-19T04:32:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.389+0000 7fc5c7fff640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7fc5cc06fac0 0x7fc5cc071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.389+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 --> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5cc0725d0 con 0x7fc5cc06fac0 2024-01-19T04:32:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.389+0000 7fc5deffd640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7fc5cc06fac0 0x7fc5cc071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.389+0000 7fc5deffd640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7fc5cc06fac0 0x7fc5cc071f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== osd.7 v2:172.21.15.156:6802/413680273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc5cc0725d0 con 0x7fc5cc06fac0 2024-01-19T04:32:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40abe20 con 0x7fdea80356e0 2024-01-19T04:32:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea40b6420 con 0x7fdea80356e0 2024-01-19T04:32:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40b67d0 con 0x7fdea80356e0 2024-01-19T04:32:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea817b210 con 0x7fdea80356e0 2024-01-19T04:32:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea817b7d0 con 0x7fdea80356e0 2024-01-19T04:32:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.393+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdea817b0a0 con 0x7fdea80356e0 2024-01-19T04:32:20.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.401+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f586401a400 con 0x7f58740c7ed0 2024-01-19T04:32:20.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.401+0000 7f585bfff640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5860066550 0x7f5860068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.401+0000 7f58737fe640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5860066550 0x7f5860068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.404 INFO:teuthology.orchestra.run.smithi133.stdout:64424509462 2024-01-19T04:32:20.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-19T04:32:20.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.401+0000 7f58737fe640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5860066550 0x7f5860068a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f586c0af000 tx=0x7f586c004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.405+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5864055c60 con 0x7f58740c7ed0 2024-01-19T04:32:20.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.405+0000 7f585bfff640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7f586006fa90 0x7f5860071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.405+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 --> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58600725a0 con 0x7f586006fa90 2024-01-19T04:32:20.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.405+0000 7f5873fff640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7f586006fa90 0x7f5860071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.405+0000 7f5873fff640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7f586006fa90 0x7f5860071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.405+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== osd.2 v2:172.21.15.133:6808/2653064077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f58600725a0 con 0x7f586006fa90 2024-01-19T04:32:20.412 INFO:teuthology.orchestra.run.smithi133.stdout:68719476760 2024-01-19T04:32:20.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-19T04:32:20.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.417+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdea40b6930 con 0x7fdea80356e0 2024-01-19T04:32:20.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.417+0000 7fde977fe640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fde9c066550 0x7fde9c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.417+0000 7fdeaeffd640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fde9c066550 0x7fde9c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.417+0000 7fdeaeffd640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fde9c066550 0x7fde9c068a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdea0007fd0 tx=0x7fdea00079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.421+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 --> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5e0160f40 con 0x7fc5cc06fac0 2024-01-19T04:32:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.421+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdea40f00c0 con 0x7fdea80356e0 2024-01-19T04:32:20.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fde977fe640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7fde9c06fa90 0x7fde9c071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 --> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde9c0725a0 con 0x7fde9c06fa90 2024-01-19T04:32:20.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5c7fff640 1 -- 172.21.15.133:0/3592717838 <== osd.7 v2:172.21.15.156:6802/413680273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5d4001250 con 0x7fc5cc06fac0 2024-01-19T04:32:20.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fdeaf7fe640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7fde9c06fa90 0x7fde9c071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fdeaf7fe640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7fde9c06fa90 0x7fde9c071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== osd.5 v2:172.21.15.156:6818/1488223936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fde9c0725a0 con 0x7fde9c06fa90 2024-01-19T04:32:20.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7fc5cc06fac0 msgr2=0x7fc5cc071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5e4c1a640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7fc5cc06fac0 0x7fc5cc071f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc5cc066580 msgr2=0x7fc5cc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5e4c1a640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc5cc066580 0x7fc5cc068a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00016c0 tx=0x7fc5d0009040 comp rx=0 tx=0).stop 2024-01-19T04:32:20.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5e0161a20 msgr2=0x7fc5e01f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5e4c1a640 1 --2- 172.21.15.133:0/3592717838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5e0161a20 0x7fc5e01f6a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5d801cd30 tx=0x7fc5d801bea0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.425+0000 7fc5dffff640 1 -- 172.21.15.133:0/3592717838 reap_dead start 2024-01-19T04:32:20.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.429+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 shutdown_connections 2024-01-19T04:32:20.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.429+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 >> 172.21.15.133:0/3592717838 conn(0x7fc5e0066b70 msgr2=0x7fc5e0071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.429+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 shutdown_connections 2024-01-19T04:32:20.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.429+0000 7fc5e4c1a640 1 -- 172.21.15.133:0/3592717838 wait complete. 2024-01-19T04:32:20.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.453+0000 7f5879e53640 1 -- 172.21.15.133:0/3316579046 --> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f587416baf0 con 0x7f586006fa90 2024-01-19T04:32:20.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.453+0000 7f585bfff640 1 -- 172.21.15.133:0/3316579046 <== osd.2 v2:172.21.15.133:6808/2653064077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58680012d0 con 0x7f586006fa90 2024-01-19T04:32:20.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7f586006fa90 msgr2=0x7f5860071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7f586006fa90 0x7f5860071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi133.stdout:60129542166 2024-01-19T04:32:20.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5860066550 msgr2=0x7f5860068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5860066550 0x7f5860068a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f586c0af000 tx=0x7f586c004ac0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58740c7ed0 msgr2=0x7f58741529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 --2- 172.21.15.133:0/3316579046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58740c7ed0 0x7f58741529f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f586400b3e0 tx=0x7f586400b8a0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5873fff640 1 -- 172.21.15.133:0/3316579046 reap_dead start 2024-01-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 shutdown_connections 2024-01-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 >> 172.21.15.133:0/3316579046 conn(0x7f587406aa60 msgr2=0x7f5874149bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 shutdown_connections 2024-01-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.457+0000 7f5859ffb640 1 -- 172.21.15.133:0/3316579046 wait complete. 2024-01-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.461+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 --> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdea80d62b0 con 0x7fde9c06fa90 2024-01-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.461+0000 7fde977fe640 1 -- 172.21.15.133:0/620426809 <== osd.5 v2:172.21.15.156:6818/1488223936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdeb004eef0 con 0x7fde9c06fa90 2024-01-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.461+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7fde9c06fa90 msgr2=0x7fde9c071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.461+0000 7fdeb552e640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7fde9c06fa90 0x7fde9c071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fde9c066550 msgr2=0x7fde9c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fde9c066550 0x7fde9c068a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdea0007fd0 tx=0x7fdea00079a0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea80356e0 msgr2=0x7fdea804fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 --2- 172.21.15.133:0/620426809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea80356e0 0x7fdea804fc00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdea401ab90 tx=0x7fdea4019280 comp rx=0 tx=0).stop 2024-01-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeaf7fe640 1 -- 172.21.15.133:0/620426809 reap_dead start 2024-01-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 shutdown_connections 2024-01-19T04:32:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 >> 172.21.15.133:0/620426809 conn(0x7fdea804d4c0 msgr2=0x7fdea80d99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 shutdown_connections 2024-01-19T04:32:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.469+0000 7fdeb552e640 1 -- 172.21.15.133:0/620426809 wait complete. 2024-01-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a230e9640 1 Processor -- start 2024-01-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a230e9640 1 -- start start 2024-01-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a230e9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a140469e0 0x7f8a140dc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a230e9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14047300 con 0x7f8a14045130 2024-01-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a230e9640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14046dc0 con 0x7f8a140339d0 2024-01-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a230e9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140dbde0 con 0x7f8a140469e0 2024-01-19T04:32:20.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a1bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8a14045130 0x7f8a140332c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39430/0 (socket says 172.21.15.133:39430) 2024-01-19T04:32:20.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.481+0000 7f8a1bfff640 1 -- 172.21.15.133:0/1081951154 learned_addr learned my addr 172.21.15.133:0/1081951154 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.487 INFO:teuthology.orchestra.run.smithi133.stdout:68719476759 2024-01-19T04:32:20.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-19T04:32:20.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.485+0000 7f8a20e85640 1 --2- 172.21.15.133:0/1081951154 >> v2:172.21.15.133:3300/0 conn(0x7f8a140469e0 0x7f8a140dc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.489+0000 7f8a1b7fe640 1 -- 172.21.15.133:0/1081951154 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660650906 0 0) 0x7f8a14047300 con 0x7f8a14045130 2024-01-19T04:32:20.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.489+0000 7f8a1b7fe640 1 -- 172.21.15.133:0/1081951154 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a0c007940 con 0x7f8a14045130 2024-01-19T04:32:20.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.489+0000 7f8a20e85640 1 -- 172.21.15.133:0/1081951154 >> v1:172.21.15.156:6789/0 conn(0x7f8a140339d0 legacy=0x7f8a140e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.489+0000 7f8a20e85640 1 -- 172.21.15.133:0/1081951154 >> v1:172.21.15.133:6789/0 conn(0x7f8a14045130 legacy=0x7f8a140332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.489+0000 7f8a20e85640 1 -- 172.21.15.133:0/1081951154 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14005f40 con 0x7f8a140469e0 2024-01-19T04:32:20.499 INFO:teuthology.orchestra.run.smithi133.stdout:64424509463 2024-01-19T04:32:20.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-19T04:32:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.505+0000 7f8a20e85640 1 --2- 172.21.15.133:0/1081951154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140dc270 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800ba60 tx=0x7f8a0801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06ef736a898119a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7f1a97a88640 1 Processor -- start 2024-01-19T04:32:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 Processor -- start 2024-01-19T04:32:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7f1a97a88640 1 -- start start 2024-01-19T04:32:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 -- start start 2024-01-19T04:32:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcad814f990 0x7fcad80c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcad80c1930 0x7fcad80c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80c5d10 con 0x7fcad80c1000 2024-01-19T04:32:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8072220 con 0x7fcad80c1930 2024-01-19T04:32:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7fcae00f9640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8071310 con 0x7fcad814f990 2024-01-19T04:32:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.513+0000 7f1a97a88640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 0x7f1a8804e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7f1a97a88640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a8804ee80 0x7f1a8804f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7f1a97a88640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a880e1090 con 0x7f1a880d6ef0 2024-01-19T04:32:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7f1a97a88640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a88035f90 con 0x7f1a8804ee80 2024-01-19T04:32:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7f1a97a88640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880d72d0 con 0x7f1a880dd600 2024-01-19T04:32:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7fcadde95640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcad814f990 0x7fcad80c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7fcadde95640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcad814f990 0x7fcad80c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44602/0 (socket says 172.21.15.133:44602) 2024-01-19T04:32:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.517+0000 7fcadde95640 1 -- 172.21.15.133:0/1727742400 learned_addr learned my addr 172.21.15.133:0/1727742400 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7fcadde95640 1 -- 172.21.15.133:0/1727742400 >> v2:172.21.15.133:3300/0 conn(0x7fcad80c1930 msgr2=0x7fcad80c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7fcadde95640 1 --2- 172.21.15.133:0/1727742400 >> v2:172.21.15.133:3300/0 conn(0x7fcad80c1930 0x7fcad80c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7fcadde95640 1 -- 172.21.15.133:0/1727742400 >> v1:172.21.15.156:6789/0 conn(0x7fcad80c1000 legacy=0x7fcad8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7fcadde95640 1 -- 172.21.15.133:0/1727742400 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80724c0 con 0x7fcad814f990 2024-01-19T04:32:20.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7f1a95023640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 0x7f1a8804e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7f1a95023640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 0x7f1a8804e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:38076/0 (socket says 172.21.15.133:38076) 2024-01-19T04:32:20.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.525+0000 7f1a95023640 1 -- 172.21.15.133:0/1849846746 learned_addr learned my addr 172.21.15.133:0/1849846746 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.529+0000 7f1a95023640 1 -- 172.21.15.133:0/1849846746 >> v2:172.21.15.133:3300/0 conn(0x7f1a8804ee80 msgr2=0x7f1a8804f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.529+0000 7f1a95023640 1 --2- 172.21.15.133:0/1849846746 >> v2:172.21.15.133:3300/0 conn(0x7f1a8804ee80 0x7f1a8804f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.529+0000 7f1a95023640 1 -- 172.21.15.133:0/1849846746 >> v1:172.21.15.133:6789/0 conn(0x7f1a880d6ef0 legacy=0x7f1a880472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.529+0000 7f1a95023640 1 -- 172.21.15.133:0/1849846746 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880479c0 con 0x7f1a880dd600 2024-01-19T04:32:20.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.529+0000 7fcadde95640 1 --2- 172.21.15.133:0/1727742400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad814f990 0x7fcad80c57d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcad80cbe10 tx=0x7fcad00214f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=902f3ededad6a8e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.533+0000 7f1a95023640 1 --2- 172.21.15.133:0/1849846746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 0x7f1a8804e940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a88035110 tx=0x7f1a8c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b7d7ba6688db88b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.533+0000 7fcadce93640 1 -- 172.21.15.133:0/1727742400 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad00b5620 con 0x7fcad814f990 2024-01-19T04:32:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.533+0000 7fcadce93640 1 -- 172.21.15.133:0/1727742400 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad00b5780 con 0x7fcad814f990 2024-01-19T04:32:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.533+0000 7fcadce93640 1 -- 172.21.15.133:0/1727742400 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad00b5b30 con 0x7fcad814f990 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 -- 172.21.15.133:0/1727742400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad814f990 msgr2=0x7fcad80c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 --2- 172.21.15.133:0/1727742400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad814f990 0x7fcad80c57d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcad80cbe10 tx=0x7fcad00214f0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 -- 172.21.15.133:0/1727742400 shutdown_connections 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 --2- 172.21.15.133:0/1727742400 >> v2:172.21.15.133:3300/0 conn(0x7fcad80c1930 0x7fcad80c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 --2- 172.21.15.133:0/1727742400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad814f990 0x7fcad80c57d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 -- 172.21.15.133:0/1727742400 >> 172.21.15.133:0/1727742400 conn(0x7fcad806aa60 msgr2=0x7fcad806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 -- 172.21.15.133:0/1727742400 shutdown_connections 2024-01-19T04:32:20.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 -- 172.21.15.133:0/1727742400 wait complete. 2024-01-19T04:32:20.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 Processor -- start 2024-01-19T04:32:20.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 -- start start 2024-01-19T04:32:20.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.537+0000 7fcae00f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcad80c1000 0x7fcad814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f1a94822640 1 -- 172.21.15.133:0/1849846746 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0ab600 con 0x7f1a880dd600 2024-01-19T04:32:20.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f1a94822640 1 -- 172.21.15.133:0/1849846746 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0ab760 con 0x7f1a880dd600 2024-01-19T04:32:20.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f1a94822640 1 -- 172.21.15.133:0/1849846746 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0abaf0 con 0x7f1a880dd600 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcae00f9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80c1930 0x7fcad81485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcae00f9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 0x7fcad81ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcae00f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8200350 con 0x7fcad80c1000 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcae00f9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8200630 con 0x7fcad80c1930 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcae00f9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8200910 con 0x7fcad814f990 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a1b7fe640 1 -- 172.21.15.133:0/1081951154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080a58a0 con 0x7f8a140469e0 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a1b7fe640 1 -- 172.21.15.133:0/1081951154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a080a5a00 con 0x7f8a140469e0 2024-01-19T04:32:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a1b7fe640 1 -- 172.21.15.133:0/1081951154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080a5d90 con 0x7f8a140469e0 2024-01-19T04:32:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcade696640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 0x7fcad81ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f1a97a88640 1 -- 172.21.15.133:0/1849846746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 msgr2=0x7f1a8804e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1849846746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 0x7f1a8804e940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a88035110 tx=0x7f1a8c01c440 comp rx=0 tx=0).stop 2024-01-19T04:32:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcade696640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 0x7fcad81ffa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:38086/0 (socket says 172.21.15.133:38086) 2024-01-19T04:32:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcade696640 1 -- 172.21.15.133:0/2766792263 learned_addr learned my addr 172.21.15.133:0/2766792263 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7fcadd694640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80c1930 0x7fcad81485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 -- 172.21.15.133:0/1081951154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 msgr2=0x7f8a140dc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1081951154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140dc270 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800ba60 tx=0x7f8a0801c8e0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 -- 172.21.15.133:0/1081951154 shutdown_connections 2024-01-19T04:32:20.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1081951154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140dc270 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 -- 172.21.15.133:0/1081951154 >> 172.21.15.133:0/1081951154 conn(0x7f8a14050190 msgr2=0x7f8a140505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 -- 172.21.15.133:0/1081951154 shutdown_connections 2024-01-19T04:32:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f1a97a88640 1 -- 172.21.15.133:0/1849846746 shutdown_connections 2024-01-19T04:32:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1849846746 >> v2:172.21.15.133:3300/0 conn(0x7f1a8804ee80 0x7f1a8804f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1849846746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a880dd600 0x7f1a8804e940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f1a97a88640 1 -- 172.21.15.133:0/1849846746 >> 172.21.15.133:0/1849846746 conn(0x7f1a8800e100 msgr2=0x7f1a8800e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.541+0000 7f8a230e9640 1 -- 172.21.15.133:0/1081951154 wait complete. 2024-01-19T04:32:20.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 Processor -- start 2024-01-19T04:32:20.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 -- start start 2024-01-19T04:32:20.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a140339d0 0x7f8a1417b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 0x7f8a140d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1417c790 con 0x7f8a140469e0 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1417bef0 con 0x7f8a14045130 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7f8a230e9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1417c1d0 con 0x7f8a140339d0 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7fcade696640 1 -- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80c1930 msgr2=0x7fcad81485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7fcade696640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80c1930 0x7fcad81485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7fcade696640 1 -- 172.21.15.133:0/2766792263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcad80c1000 msgr2=0x7fcad814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7fcade696640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcad80c1000 0x7fcad814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.545+0000 7fcade696640 1 -- 172.21.15.133:0/2766792263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00079d0 con 0x7fcad814f990 2024-01-19T04:32:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7f1a97a88640 1 -- 172.21.15.133:0/1849846746 shutdown_connections 2024-01-19T04:32:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7f1a97a88640 1 -- 172.21.15.133:0/1849846746 wait complete. 2024-01-19T04:32:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7f1a97a88640 1 Processor -- start 2024-01-19T04:32:20.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 0x7f8a140d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7f1a97a88640 1 -- start start 2024-01-19T04:32:20.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7f1a97a88640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a8804ee80 0x7f1a880cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.549+0000 7fcade696640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 0x7fcad81ffa30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c390 tx=0x7fcac800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a97a88640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a880d6ef0 0x7f1a88051330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 0x7f8a140d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44618/0 (socket says 172.21.15.133:44618) 2024-01-19T04:32:20.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f8a1bfff640 1 -- 172.21.15.133:0/1433772352 learned_addr learned my addr 172.21.15.133:0/1433772352 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a97a88640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 0x7f1a88051870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a97a88640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88008d30 con 0x7f1a880dd600 2024-01-19T04:32:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a97a88640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88008a70 con 0x7f1a880d6ef0 2024-01-19T04:32:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a97a88640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88008330 con 0x7f1a8804ee80 2024-01-19T04:32:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a95023640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a880d6ef0 0x7f1a88051330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f8a20e85640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a140339d0 0x7f8a1417b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f8a21686640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.553+0000 7f1a96025640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 0x7f1a88051870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f1a96025640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 0x7f1a88051870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56534/0 (socket says 172.21.15.133:56534) 2024-01-19T04:32:20.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f1a96025640 1 -- 172.21.15.133:0/1659876092 learned_addr learned my addr 172.21.15.133:0/1659876092 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f8a1bfff640 1 -- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a140339d0 msgr2=0x7f8a1417b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f8a1bfff640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a140339d0 0x7f8a1417b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f8a1bfff640 1 -- 172.21.15.133:0/1433772352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 msgr2=0x7f8a140d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f8a1bfff640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f8a1bfff640 1 -- 172.21.15.133:0/1433772352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0800b6c0 con 0x7f8a14045130 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac80052d0 con 0x7fcad814f990 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8005430 con 0x7fcad814f990 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8007240 con 0x7fcad814f990 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad8149ce0 con 0x7fcad814f990 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad814a2a0 con 0x7fcad814f990 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac00052a0 con 0x7fcad814f990 2024-01-19T04:32:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.557+0000 7f1a95824640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a8804ee80 0x7f1a880cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.561+0000 7f8a1bfff640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 0x7f8a140d1b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0758e0 tx=0x7f8a1c06ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.561+0000 7f1a96025640 1 -- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a8804ee80 msgr2=0x7f1a880cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.561+0000 7f1a96025640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a8804ee80 0x7f1a880cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.561+0000 7f1a96025640 1 -- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a880d6ef0 msgr2=0x7f1a88051330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.561+0000 7f1a96025640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a880d6ef0 0x7f1a88051330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.561+0000 7f1a96025640 1 -- 172.21.15.133:0/1659876092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0094d0 con 0x7f1a880dd600 2024-01-19T04:32:20.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.569+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c06c520 con 0x7f8a14045130 2024-01-19T04:32:20.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.569+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c08e070 con 0x7f8a14045130 2024-01-19T04:32:20.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.569+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c06a860 con 0x7f8a14045130 2024-01-19T04:32:20.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.569+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1417c4b0 con 0x7f8a14045130 2024-01-19T04:32:20.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.569+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a140d4df0 con 0x7f8a14045130 2024-01-19T04:32:20.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.573+0000 7f1a96025640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 0x7f1a88051870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a90073640 tx=0x7f1a9006cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.573+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc0052a0 con 0x7f8a14045130 2024-01-19T04:32:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.577+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900681b0 con 0x7f1a880dd600 2024-01-19T04:32:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.577+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90068350 con 0x7f1a880dd600 2024-01-19T04:32:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.577+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a880cc630 con 0x7f1a880dd600 2024-01-19T04:32:20.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.581+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90074240 con 0x7f1a880dd600 2024-01-19T04:32:20.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.581+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a88048cd0 con 0x7f1a880dd600 2024-01-19T04:32:20.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.581+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a880ccb50 con 0x7f1a880dd600 2024-01-19T04:32:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.585+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcac80073a0 con 0x7fcad814f990 2024-01-19T04:32:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.589+0000 7fcace7fc640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcabc066500 0x7fcabc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.589+0000 7fcadde95640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcabc066500 0x7fcabc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.589+0000 7fcadde95640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcabc066500 0x7fcabc0689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcad00b6000 tx=0x7fcad0004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.593+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcac8054550 con 0x7fcad814f990 2024-01-19T04:32:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.593+0000 7f9ab4c79640 1 Processor -- start 2024-01-19T04:32:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.593+0000 7f9ab4c79640 1 -- start start 2024-01-19T04:32:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.597+0000 7f9ab4c79640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80d5dc0 0x7f9aa8047da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.597+0000 7f9ab4c79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9aa80464f0 0x7f9aa8007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.597+0000 7f9ab4c79640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa8008130 con 0x7f9aa80dc460 2024-01-19T04:32:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.597+0000 7f9ab4c79640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa8034b90 con 0x7f9aa80464f0 2024-01-19T04:32:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.597+0000 7f9ab4c79640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8046940 con 0x7f9aa80d5dc0 2024-01-19T04:32:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.597+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8a1c09e480 con 0x7f8a14045130 2024-01-19T04:32:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.601+0000 7f8a197fa640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8a00066580 0x7f8a00068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.601+0000 7f8a20e85640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8a00066580 0x7f8a00068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.601+0000 7f8a20e85640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8a00066580 0x7f8a00068a40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a080af000 tx=0x7f8a080a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a1c0cf990 con 0x7f8a14045130 2024-01-19T04:32:20.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7fbd34008640 1 Processor -- start 2024-01-19T04:32:20.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7fbd34008640 1 -- start start 2024-01-19T04:32:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7fbd34008640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 0x7fbd2c0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7fbd34008640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c0c3200 con 0x7fbd2c0c8dc0 2024-01-19T04:32:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7fbd34008640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c0c3a90 con 0x7fbd2c0c3690 2024-01-19T04:32:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.605+0000 7fbd34008640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c0b0530 con 0x7fbd2c151640 2024-01-19T04:32:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.613+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1a90090070 con 0x7f1a880dd600 2024-01-19T04:32:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.617+0000 7f1a867fc640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a74066550 0x7f1a74068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.617+0000 7f1a95824640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a74066550 0x7f1a74068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.617+0000 7f1a95824640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a74066550 0x7f1a74068a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a80001600 tx=0x7f1a80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.617+0000 7f9aaffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9aa80464f0 0x7f9aa8007bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.617+0000 7f9aaffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9aa80464f0 0x7f9aa8007bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56548/0 (socket says 172.21.15.133:56548) 2024-01-19T04:32:20.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.617+0000 7f9aaffff640 1 -- 172.21.15.133:0/3265049782 learned_addr learned my addr 172.21.15.133:0/3265049782 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 Processor -- start 2024-01-19T04:32:20.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 -- start start 2024-01-19T04:32:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6301536b0 0x7fe6300c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe630153a90 0x7fe63006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe6300c2bc0 0x7fe6300c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300c1330 con 0x7fe6301536b0 2024-01-19T04:32:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300c6a90 con 0x7fe6300c2bc0 2024-01-19T04:32:20.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.625+0000 7fe634fdc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63006e000 con 0x7fe630153a90 2024-01-19T04:32:20.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.637+0000 7f2041190640 1 Processor -- start 2024-01-19T04:32:20.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.637+0000 7f2041190640 1 -- start start 2024-01-19T04:32:20.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.637+0000 7f2041190640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f203c0cbde0 0x7f203c162e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.637+0000 7f2041190640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0c65a0 con 0x7f203c1512f0 2024-01-19T04:32:20.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.637+0000 7f2041190640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c157650 con 0x7f203c1516d0 2024-01-19T04:32:20.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.637+0000 7f2041190640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c158450 con 0x7f203c0cbde0 2024-01-19T04:32:20.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 Processor -- start 2024-01-19T04:32:20.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 -- start start 2024-01-19T04:32:20.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f374c151740 0x7f374c157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c0c5db0 0x7f374c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0c7500 con 0x7f374c06ea80 2024-01-19T04:32:20.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0c7ed0 con 0x7f374c151740 2024-01-19T04:32:20.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.641+0000 7f37537ac640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c151b20 con 0x7f374c0c5db0 2024-01-19T04:32:20.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.841+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a900cf7b0 con 0x7f1a880dd600 2024-01-19T04:32:20.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.841+0000 7f9aaf7fe640 1 --2- 172.21.15.133:0/3265049782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80d5dc0 0x7f9aa8047da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.849+0000 7f9aaf7fe640 1 -- 172.21.15.133:0/3265049782 >> v2:172.21.15.133:3300/0 conn(0x7f9aa80464f0 msgr2=0x7f9aa8007bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.849+0000 7f9aaf7fe640 1 --2- 172.21.15.133:0/3265049782 >> v2:172.21.15.133:3300/0 conn(0x7f9aa80464f0 0x7f9aa8007bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.849+0000 7f9aaf7fe640 1 -- 172.21.15.133:0/3265049782 >> v1:172.21.15.133:6789/0 conn(0x7f9aa80dc460 legacy=0x7f9aa804c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.849+0000 7f9aaf7fe640 1 -- 172.21.15.133:0/3265049782 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80d61a0 con 0x7f9aa80d5dc0 2024-01-19T04:32:20.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.857+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1a900cb3f0 con 0x7f1a880dd600 2024-01-19T04:32:20.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.865+0000 7fbd325a5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbd2c0c8dc0 0x7fbd2c15a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39462/0 (socket says 172.21.15.133:39462) 2024-01-19T04:32:20.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.865+0000 7fbd325a5640 1 -- 172.21.15.133:0/3170134903 learned_addr learned my addr 172.21.15.133:0/3170134903 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.869+0000 7fe62e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6301536b0 0x7fe6300c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.869+0000 7f203ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f203c1512f0 0x7f203c15b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39464/0 (socket says 172.21.15.133:39464) 2024-01-19T04:32:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.869+0000 7f203ad9d640 1 -- 172.21.15.133:0/1061911209 learned_addr learned my addr 172.21.15.133:0/1061911209 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.869+0000 7f203b59e640 1 --2- 172.21.15.133:0/1061911209 >> v2:172.21.15.133:3300/0 conn(0x7f203c0cbde0 0x7f203c162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.873+0000 7fe62e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6301536b0 0x7fe6300c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56552/0 (socket says 172.21.15.133:56552) 2024-01-19T04:32:20.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.873+0000 7fe62e59c640 1 -- 172.21.15.133:0/3481068841 learned_addr learned my addr 172.21.15.133:0/3481068841 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.873+0000 7f3751548640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f374c151740 0x7f374c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.877+0000 7f3751548640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f374c151740 0x7f374c157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56560/0 (socket says 172.21.15.133:56560) 2024-01-19T04:32:20.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.877+0000 7f3751548640 1 -- 172.21.15.133:0/2562497881 learned_addr learned my addr 172.21.15.133:0/2562497881 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.881+0000 7f203b59e640 1 -- 172.21.15.133:0/1061911209 >> v1:172.21.15.156:6789/0 conn(0x7f203c1516d0 legacy=0x7f203c0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.881+0000 7f203b59e640 1 -- 172.21.15.133:0/1061911209 >> v1:172.21.15.133:6789/0 conn(0x7f203c1512f0 legacy=0x7f203c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.881+0000 7f203b59e640 1 -- 172.21.15.133:0/1061911209 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c1578f0 con 0x7f203c0cbde0 2024-01-19T04:32:20.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.885+0000 7f3751548640 1 -- 172.21.15.133:0/2562497881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c0c5db0 msgr2=0x7f374c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.885+0000 7f3751548640 1 --2- 172.21.15.133:0/2562497881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c0c5db0 0x7f374c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.885+0000 7f3751548640 1 -- 172.21.15.133:0/2562497881 >> v1:172.21.15.156:6789/0 conn(0x7f374c06ea80 legacy=0x7f374c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.885+0000 7f3751548640 1 -- 172.21.15.133:0/2562497881 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0c8d40 con 0x7f374c151740 2024-01-19T04:32:20.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.885+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041405708 0 0) 0x7fbd2c0c3200 con 0x7fbd2c0c8dc0 2024-01-19T04:32:20.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.885+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd18003530 con 0x7fbd2c0c8dc0 2024-01-19T04:32:20.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.889+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8a1c0cb5d0 con 0x7f8a14045130 2024-01-19T04:32:20.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.889+0000 7fe62e59c640 1 -- 172.21.15.133:0/3481068841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe630153a90 msgr2=0x7fe63006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.889+0000 7fe62e59c640 1 --2- 172.21.15.133:0/3481068841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe630153a90 0x7fe63006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.889+0000 7fe62e59c640 1 -- 172.21.15.133:0/3481068841 >> v2:172.21.15.156:3300/0 conn(0x7fe6300c2bc0 msgr2=0x7fe6300c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.889+0000 7fe62e59c640 1 --2- 172.21.15.133:0/3481068841 >> v2:172.21.15.156:3300/0 conn(0x7fe6300c2bc0 0x7fe6300c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.889+0000 7fe62e59c640 1 -- 172.21.15.133:0/3481068841 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63006e2e0 con 0x7fe6301536b0 2024-01-19T04:32:20.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.897+0000 7fe62e59c640 1 --2- 172.21.15.133:0/3481068841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6301536b0 0x7fe6300c7280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe63006d850 tx=0x7fe62001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389ede9aa9d6672f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.897+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcac8050890 con 0x7fcad814f990 2024-01-19T04:32:20.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.897+0000 7f203b59e640 1 --2- 172.21.15.133:0/1061911209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c0cbde0 0x7f203c162e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2034009d90 tx=0x7f203401f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eda8dd201c03879 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.901+0000 7f9aaf7fe640 1 --2- 172.21.15.133:0/3265049782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80d5dc0 0x7f9aa8047da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40097c0 tx=0x7f9aa401ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a8f71d4d4ce78b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.905+0000 7f3751548640 1 --2- 172.21.15.133:0/2562497881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c157380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3748009870 tx=0x7f374801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f660a9f6aef6486 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f203a59c640 1 -- 172.21.15.133:0/1061911209 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340af600 con 0x7f203c0cbde0 2024-01-19T04:32:20.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f203a59c640 1 -- 172.21.15.133:0/1061911209 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20340ab050 con 0x7f203c0cbde0 2024-01-19T04:32:20.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f203a59c640 1 -- 172.21.15.133:0/1061911209 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340af980 con 0x7f203c0cbde0 2024-01-19T04:32:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe62dd9b640 1 -- 172.21.15.133:0/3481068841 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200a89b0 con 0x7fe6301536b0 2024-01-19T04:32:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe62dd9b640 1 -- 172.21.15.133:0/3481068841 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6200a8b10 con 0x7fe6301536b0 2024-01-19T04:32:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe62dd9b640 1 -- 172.21.15.133:0/3481068841 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200a8ea0 con 0x7fe6301536b0 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 -- 172.21.15.133:0/1061911209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c0cbde0 msgr2=0x7f203c162e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 --2- 172.21.15.133:0/1061911209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c0cbde0 0x7f203c162e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2034009d90 tx=0x7f203401f100 comp rx=0 tx=0).stop 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 -- 172.21.15.133:0/1061911209 shutdown_connections 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 --2- 172.21.15.133:0/1061911209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c0cbde0 0x7f203c162e60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 -- 172.21.15.133:0/1061911209 >> 172.21.15.133:0/1061911209 conn(0x7f203c072890 msgr2=0x7f203c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 -- 172.21.15.133:0/1061911209 shutdown_connections 2024-01-19T04:32:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7f2041190640 1 -- 172.21.15.133:0/1061911209 wait complete. 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 -- 172.21.15.133:0/3481068841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6301536b0 msgr2=0x7fe6300c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 --2- 172.21.15.133:0/3481068841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6301536b0 0x7fe6300c7280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe63006d850 tx=0x7fe62001ecf0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 -- 172.21.15.133:0/3481068841 shutdown_connections 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 --2- 172.21.15.133:0/3481068841 >> v2:172.21.15.156:3300/0 conn(0x7fe6300c2bc0 0x7fe6300c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 --2- 172.21.15.133:0/3481068841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe630153a90 0x7fe63006ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 --2- 172.21.15.133:0/3481068841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6301536b0 0x7fe6300c7280 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 -- 172.21.15.133:0/3481068841 >> 172.21.15.133:0/3481068841 conn(0x7fe63006b770 msgr2=0x7fe63006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 -- 172.21.15.133:0/3481068841 shutdown_connections 2024-01-19T04:32:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.909+0000 7fe634fdc640 1 -- 172.21.15.133:0/3481068841 wait complete. 2024-01-19T04:32:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 Processor -- start 2024-01-19T04:32:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 -- start start 2024-01-19T04:32:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fbd31da4640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 0x7fbd2c0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 Processor -- start 2024-01-19T04:32:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 -- start start 2024-01-19T04:32:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f203c0cbde0 0x7f203c0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f203c1512f0 0x7f203c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c1516d0 0x7f203c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c15ad60 con 0x7f203c1516d0 2024-01-19T04:32:20.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1ec0f0 con 0x7f203c0cbde0 2024-01-19T04:32:20.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7f2041190640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1ebb90 con 0x7f203c1512f0 2024-01-19T04:32:20.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6300c2bc0 0x7fe6300c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 0x7fe630154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6300c4f00 0x7fe630154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301f0410 con 0x7fe6300c4f00 2024-01-19T04:32:20.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300c6030 con 0x7fe6300c4ac0 2024-01-19T04:32:20.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.913+0000 7fe634fdc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301ef890 con 0x7fe6300c2bc0 2024-01-19T04:32:20.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7f203ad9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f203c0cbde0 0x7f203c0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7fe627fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 0x7fe630154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7f203ad9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f203c0cbde0 0x7f203c0c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44646/0 (socket says 172.21.15.133:44646) 2024-01-19T04:32:20.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7f203ad9d640 1 -- 172.21.15.133:0/1423586339 learned_addr learned my addr 172.21.15.133:0/1423586339 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7fe627fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 0x7fe630154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44656/0 (socket says 172.21.15.133:44656) 2024-01-19T04:32:20.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7fe627fff640 1 -- 172.21.15.133:0/1927707250 learned_addr learned my addr 172.21.15.133:0/1927707250 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.917+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458755085 0 0) 0x7fbd18003530 con 0x7fbd2c0c8dc0 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 msgr2=0x7fbd2c0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 0x7fbd2c0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 >> v1:172.21.15.156:6789/0 conn(0x7fbd2c0c3690 legacy=0x7fbd2c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0c9230 con 0x7fbd2c0c8dc0 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fbd24001a00 con 0x7fbd2c0c8dc0 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 >> v1:172.21.15.133:6789/0 conn(0x7fbd2c0c8dc0 legacy=0x7fbd2c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd18003a20 0x7fbd18003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd180047d0 0x7fbd18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 0x7fbd1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c0b0530 con 0x7fbd18003a20 2024-01-19T04:32:20.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18005580 con 0x7fbd180047d0 2024-01-19T04:32:20.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1800bed0 con 0x7fbd2c151640 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f3743fff640 1 -- 172.21.15.133:0/2562497881 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480a89b0 con 0x7f374c151740 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f3743fff640 1 -- 172.21.15.133:0/2562497881 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480a8b10 con 0x7f374c151740 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f3743fff640 1 -- 172.21.15.133:0/2562497881 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480a8ea0 con 0x7f374c151740 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 -- 172.21.15.133:0/2562497881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 msgr2=0x7f374c157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 --2- 172.21.15.133:0/2562497881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c157380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3748009870 tx=0x7f374801ecf0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 -- 172.21.15.133:0/2562497881 shutdown_connections 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 --2- 172.21.15.133:0/2562497881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c0c5db0 0x7f374c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 --2- 172.21.15.133:0/2562497881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c157380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 -- 172.21.15.133:0/2562497881 >> 172.21.15.133:0/2562497881 conn(0x7f374c06b770 msgr2=0x7f374c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 -- 172.21.15.133:0/2562497881 shutdown_connections 2024-01-19T04:32:20.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.921+0000 7f37537ac640 1 -- 172.21.15.133:0/2562497881 wait complete. 2024-01-19T04:32:20.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 Processor -- start 2024-01-19T04:32:20.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 -- start start 2024-01-19T04:32:20.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f203b59e640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c1516d0 0x7f203c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7fe627fff640 1 -- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6300c2bc0 msgr2=0x7fe6300c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7fe627fff640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6300c2bc0 0x7fe6300c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7fe627fff640 1 -- 172.21.15.133:0/1927707250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6300c4f00 msgr2=0x7fe630154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7fe627fff640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6300c4f00 0x7fe630154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7fe627fff640 1 -- 172.21.15.133:0/1927707250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200094d0 con 0x7fe6300c4ac0 2024-01-19T04:32:20.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7fbd31da4640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd18003a20 0x7fbd18003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c06ea80 0x7f374c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f374c0c5db0 0x7f374c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c1584e0 con 0x7f374c151740 2024-01-19T04:32:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c159020 con 0x7f374c0c5db0 2024-01-19T04:32:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.925+0000 7f37537ac640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c15a490 con 0x7f374c06ea80 2024-01-19T04:32:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.929+0000 7fbd31da4640 1 -- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 msgr2=0x7fbd1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.929+0000 7fbd31da4640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c151640 0x7fbd1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.929+0000 7fbd31da4640 1 -- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd180047d0 msgr2=0x7fbd18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.929+0000 7fbd31da4640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd180047d0 0x7fbd18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.929+0000 7fbd31da4640 1 -- 172.21.15.133:0/3170134903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18003530 con 0x7fbd18003a20 2024-01-19T04:32:20.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f203b59e640 1 -- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f203c1512f0 msgr2=0x7f203c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f203b59e640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f203c1512f0 0x7f203c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f203b59e640 1 -- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f203c0cbde0 msgr2=0x7f203c0c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f203b59e640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f203c0cbde0 0x7f203c0c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f203b59e640 1 -- 172.21.15.133:0/1423586339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2034009a70 con 0x7f203c1516d0 2024-01-19T04:32:20.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9aae7fc640 1 -- 172.21.15.133:0/3265049782 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a88f0 con 0x7f9aa80d5dc0 2024-01-19T04:32:20.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9aae7fc640 1 -- 172.21.15.133:0/3265049782 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40a8a50 con 0x7f9aa80d5dc0 2024-01-19T04:32:20.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9aae7fc640 1 -- 172.21.15.133:0/3265049782 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a8de0 con 0x7f9aa80d5dc0 2024-01-19T04:32:20.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 -- 172.21.15.133:0/3265049782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80d5dc0 msgr2=0x7f9aa8047da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/3265049782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80d5dc0 0x7f9aa8047da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40097c0 tx=0x7f9aa401ec30 comp rx=0 tx=0).stop 2024-01-19T04:32:20.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f3751d49640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 -- 172.21.15.133:0/3265049782 shutdown_connections 2024-01-19T04:32:20.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/3265049782 >> v2:172.21.15.133:3300/0 conn(0x7f9aa80464f0 0x7f9aa8007bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/3265049782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80d5dc0 0x7f9aa8047da0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 -- 172.21.15.133:0/3265049782 >> 172.21.15.133:0/3265049782 conn(0x7f9aa80512a0 msgr2=0x7f9aa80516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:20.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f203b59e640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c1516d0 0x7f203c14fb70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20340af000 tx=0x7f203401bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 -- 172.21.15.133:0/3265049782 shutdown_connections 2024-01-19T04:32:20.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f3751d49640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c06e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56588/0 (socket says 172.21.15.133:56588) 2024-01-19T04:32:20.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f3751d49640 1 -- 172.21.15.133:0/3557112737 learned_addr learned my addr 172.21.15.133:0/3557112737 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.933+0000 7f9ab4c79640 1 -- 172.21.15.133:0/3265049782 wait complete. 2024-01-19T04:32:20.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 Processor -- start 2024-01-19T04:32:20.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 -- start start 2024-01-19T04:32:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9aa80464f0 0x7f9aa80d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa80d5dc0 0x7f9aa80dab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 0x7f9aa80de450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80dfd60 con 0x7f9aa80d5dc0 2024-01-19T04:32:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80d2c80 con 0x7f9aa80464f0 2024-01-19T04:32:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.937+0000 7f9ab4c79640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80d2f60 con 0x7f9aa80dc460 2024-01-19T04:32:20.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340ba680 con 0x7f203c1516d0 2024-01-19T04:32:20.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20340ba7e0 con 0x7f203c1516d0 2024-01-19T04:32:20.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340bab50 con 0x7f203c1516d0 2024-01-19T04:32:20.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7fe627fff640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 0x7fe630154540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe61800b410 tx=0x7fe61800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7fbd31da4640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd18003a20 0x7fbd18003e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800ba10 tx=0x7fbd2801c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc175ae4d25043a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c1ef5a0 con 0x7f203c1516d0 2024-01-19T04:32:20.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.941+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c1ee7e0 con 0x7f203c1516d0 2024-01-19T04:32:20.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.945+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c15aa90 con 0x7f203c1516d0 2024-01-19T04:32:20.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.945+0000 7f9aaffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 0x7f9aa80de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.945+0000 7f9aaffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 0x7f9aa80de450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:38198/0 (socket says 172.21.15.133:38198) 2024-01-19T04:32:20.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.945+0000 7f9aaffff640 1 -- 172.21.15.133:0/811398344 learned_addr learned my addr 172.21.15.133:0/811398344 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:20.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.949+0000 7f3750d47640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f374c0c5db0 0x7f374c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7f9aaffff640 1 -- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9aa80464f0 msgr2=0x7f9aa80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7f9aaffff640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9aa80464f0 0x7f9aa80d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7f9aaffff640 1 -- 172.21.15.133:0/811398344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa80d5dc0 msgr2=0x7f9aa80dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7f9aaffff640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa80d5dc0 0x7f9aa80dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7f9aaffff640 1 -- 172.21.15.133:0/811398344 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa4009420 con 0x7f9aa80dc460 2024-01-19T04:32:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618011830 con 0x7fe6300c4ac0 2024-01-19T04:32:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe618011990 con 0x7fe6300c4ac0 2024-01-19T04:32:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618011d40 con 0x7fe6300c4ac0 2024-01-19T04:32:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6301efb70 con 0x7fe6300c4ac0 2024-01-19T04:32:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6301f0130 con 0x7fe6300c4ac0 2024-01-19T04:32:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.953+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630074340 con 0x7fe6300c4ac0 2024-01-19T04:32:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.957+0000 7f9aaffff640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 0x7f9aa80de450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0068710 tx=0x7f9ab004eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.957+0000 7f3750d47640 1 -- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c06ea80 msgr2=0x7f374c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.957+0000 7f3750d47640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c06ea80 0x7f374c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.957+0000 7f3750d47640 1 -- 172.21.15.133:0/3557112737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 msgr2=0x7f374c06e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:20.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.957+0000 7f3750d47640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c06e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:20.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.957+0000 7f3750d47640 1 -- 172.21.15.133:0/3557112737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480094d0 con 0x7f374c0c5db0 2024-01-19T04:32:20.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.961+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f20340b6040 con 0x7f203c1516d0 2024-01-19T04:32:20.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.965+0000 7f20337fe640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f201c066550 0x7f201c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:20.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.965+0000 7f203ad9d640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f201c066550 0x7f201c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:20.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.965+0000 7f203ad9d640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f201c066550 0x7f201c068a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f202c007fd0 tx=0x7f202c007f20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:20.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.973+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0073ec0 con 0x7f9aa80dc460 2024-01-19T04:32:20.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.973+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0072050 con 0x7f9aa80dc460 2024-01-19T04:32:20.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.973+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa80df710 con 0x7f9aa80dc460 2024-01-19T04:32:20.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.973+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00742a0 con 0x7f9aa80dc460 2024-01-19T04:32:20.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.973+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa80d5080 con 0x7f9aa80dc460 2024-01-19T04:32:20.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:20.973+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa80057f0 con 0x7f9aa80dc460 2024-01-19T04:32:21.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.053+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89fc005820 con 0x7f8a14045130 2024-01-19T04:32:21.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.129+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1a880ccb50 con 0x7f1a880dd600 2024-01-19T04:32:21.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.157+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcac0005820 con 0x7fcad814f990 2024-01-19T04:32:21.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.233+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20340afe30 con 0x7f203c1516d0 2024-01-19T04:32:21.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.233+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f20340f0620 con 0x7f203c1516d0 2024-01-19T04:32:21.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.253+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a9680 con 0x7fbd18003a20 2024-01-19T04:32:21.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.253+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd280a97e0 con 0x7fbd18003a20 2024-01-19T04:32:21.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.253+0000 7fbd30da2640 1 -- 172.21.15.133:0/3170134903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a9b90 con 0x7fbd18003a20 2024-01-19T04:32:21.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- 172.21.15.133:0/3170134903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd18003a20 msgr2=0x7fbd18003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 --2- 172.21.15.133:0/3170134903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd18003a20 0x7fbd18003e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800ba10 tx=0x7fbd2801c640 comp rx=0 tx=0).stop 2024-01-19T04:32:21.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd325a5640 1 -- 172.21.15.133:0/3170134903 reap_dead start 2024-01-19T04:32:21.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- 172.21.15.133:0/3170134903 shutdown_connections 2024-01-19T04:32:21.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- 172.21.15.133:0/3170134903 >> 172.21.15.133:0/3170134903 conn(0x7fbd2c06a660 msgr2=0x7fbd2c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- 172.21.15.133:0/3170134903 shutdown_connections 2024-01-19T04:32:21.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- 172.21.15.133:0/3170134903 wait complete. 2024-01-19T04:32:21.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 Processor -- start 2024-01-19T04:32:21.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- start start 2024-01-19T04:32:21.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd18003a20 0x7fbd2c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c156390 0x7fbd2c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2c1f24c0 0x7fbd2c1ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1546c0 con 0x7fbd2c1f24c0 2024-01-19T04:32:21.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c157740 con 0x7fbd2c156390 2024-01-19T04:32:21.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.257+0000 7fbd34008640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c155f00 con 0x7fbd18003a20 2024-01-19T04:32:21.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.261+0000 7f3750d47640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f374c0c5db0 0x7f374c14a470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f373c00b3c0 tx=0x7f373c00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:21.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.269+0000 7f1a867fc640 1 -- 172.21.15.133:0/1659876092 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a880ccb50 con 0x7f1a880dd600 2024-01-19T04:32:21.271 INFO:teuthology.orchestra.run.smithi133.stdout:64424509462 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a74066550 msgr2=0x7f1a74068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a74066550 0x7f1a74068a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a80001600 tx=0x7f1a80009040 comp rx=0 tx=0).stop 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 msgr2=0x7f1a88051870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 0x7f1a88051870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a90073640 tx=0x7f1a9006cbc0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 shutdown_connections 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a74066550 0x7f1a74068a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a880d6ef0 0x7f1a88051330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a880dd600 0x7f1a88051870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 --2- 172.21.15.133:0/1659876092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a8804ee80 0x7f1a880cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 >> 172.21.15.133:0/1659876092 conn(0x7f1a8800e100 msgr2=0x7f1a88047be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 shutdown_connections 2024-01-19T04:32:21.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.273+0000 7f1a97a88640 1 -- 172.21.15.133:0/1659876092 wait complete. 2024-01-19T04:32:21.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c011830 con 0x7f374c0c5db0 2024-01-19T04:32:21.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c0119b0 con 0x7f374c0c5db0 2024-01-19T04:32:21.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c011d60 con 0x7f374c0c5db0 2024-01-19T04:32:21.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c1586f0 con 0x7f374c0c5db0 2024-01-19T04:32:21.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c158cb0 con 0x7f374c0c5db0 2024-01-19T04:32:21.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f8a197fa640 1 -- 172.21.15.133:0/1433772352 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a1c099070 con 0x7f8a14045130 2024-01-19T04:32:21.283 INFO:teuthology.orchestra.run.smithi133.stdout:60129542165 2024-01-19T04:32:21.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c074340 con 0x7f374c0c5db0 2024-01-19T04:32:21.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.281+0000 7fbd315a3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c156390 0x7fbd2c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:21.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8a00066580 msgr2=0x7f8a00068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8a00066580 0x7f8a00068a40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a080af000 tx=0x7f8a080a7070 comp rx=0 tx=0).stop 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 msgr2=0x7f8a140d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 0x7f8a140d1b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0758e0 tx=0x7f8a1c06ca50 comp rx=0 tx=0).stop 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 shutdown_connections 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8a00066580 0x7f8a00068a40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a14045130 0x7f8a140d1b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a140469e0 0x7f8a140d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 --2- 172.21.15.133:0/1433772352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a140339d0 0x7f8a1417b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 >> 172.21.15.133:0/1433772352 conn(0x7f8a14050190 msgr2=0x7f8a14050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 shutdown_connections 2024-01-19T04:32:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7f8a230e9640 1 -- 172.21.15.133:0/1433772352 wait complete. 2024-01-19T04:32:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7fbd315a3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c156390 0x7fbd2c0cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:44670/0 (socket says 172.21.15.133:44670) 2024-01-19T04:32:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.285+0000 7fbd315a3640 1 -- 172.21.15.133:0/78305242 learned_addr learned my addr 172.21.15.133:0/78305242 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:21.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.6 2024-01-19T04:32:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.293+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9ab0074400 con 0x7f9aa80dc460 2024-01-19T04:32:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.293+0000 7f9a9bfff640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9a94066550 0x7f9a94068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.293+0000 7f9aaf7fe640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9a94066550 0x7f9a94068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.293+0000 7f9aaf7fe640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9a94066550 0x7f9a94068a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40b2000 tx=0x7f9aa4004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:21.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.297+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ab00cf990 con 0x7f9aa80dc460 2024-01-19T04:32:21.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542165 for osd.0 2024-01-19T04:32:21.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.305+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe61801a400 con 0x7fe6300c4ac0 2024-01-19T04:32:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.305+0000 7fe626ffd640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe610066550 0x7fe610068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.305+0000 7fe62e59c640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe610066550 0x7fe610068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.309+0000 7fe62e59c640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe610066550 0x7fe610068a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6200b2000 tx=0x7fe620004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:21.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.309+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe618055c50 con 0x7fe6300c4ac0 2024-01-19T04:32:21.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.309+0000 7fbd31da4640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd18003a20 0x7fbd2c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:21.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.309+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9ab00cb5d0 con 0x7f9aa80dc460 2024-01-19T04:32:21.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.321+0000 7fbd31da4640 1 -- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c156390 msgr2=0x7fbd2c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.321+0000 7fbd31da4640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c156390 0x7fbd2c0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.321+0000 7fbd31da4640 1 -- 172.21.15.133:0/78305242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2c1f24c0 msgr2=0x7fbd2c1ebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.321+0000 7fbd31da4640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2c1f24c0 0x7fbd2c1ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.321+0000 7fbd31da4640 1 -- 172.21.15.133:0/78305242 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c1548b0 con 0x7fbd18003a20 2024-01-19T04:32:21.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.341+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe618051890 con 0x7fe6300c4ac0 2024-01-19T04:32:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.377+0000 7fbd31da4640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd18003a20 0x7fbd2c157200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd280ad000 tx=0x7fbd18005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.381+0000 7fcace7fc640 1 -- 172.21.15.133:0/2766792263 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcac8020070 con 0x7fcad814f990 2024-01-19T04:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout:64424509462 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcabc066500 msgr2=0x7fcabc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcabc066500 0x7fcabc0689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcad00b6000 tx=0x7fcad0004ac0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 msgr2=0x7fcad81ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 0x7fcad81ffa30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c390 tx=0x7fcac800c850 comp rx=0 tx=0).stop 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 shutdown_connections 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fcabc066500 0x7fcabc0689c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80c1930 0x7fcad81485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad814f990 0x7fcad81ffa30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 --2- 172.21.15.133:0/2766792263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcad80c1000 0x7fcad814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 >> 172.21.15.133:0/2766792263 conn(0x7fcad806aa60 msgr2=0x7fcad806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 shutdown_connections 2024-01-19T04:32:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.385+0000 7fcae00f9640 1 -- 172.21.15.133:0/2766792263 wait complete. 2024-01-19T04:32:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.393+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a9e20 con 0x7fbd18003a20 2024-01-19T04:32:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.393+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd280b3450 con 0x7fbd18003a20 2024-01-19T04:32:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.393+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c154b50 con 0x7fbd18003a20 2024-01-19T04:32:21.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.393+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280b3800 con 0x7fbd18003a20 2024-01-19T04:32:21.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.393+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c1558b0 con 0x7fbd18003a20 2024-01-19T04:32:21.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.393+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c155710 con 0x7fbd18003a20 2024-01-19T04:32:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.405+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f203c074340 con 0x7f203c1516d0 2024-01-19T04:32:21.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.3 2024-01-19T04:32:21.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f20337fe640 1 -- 172.21.15.133:0/1423586339 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20340b4070 con 0x7f203c1516d0 2024-01-19T04:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout:68719476757 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f201c066550 msgr2=0x7f201c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f201c066550 0x7f201c068a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f202c007fd0 tx=0x7f202c007f20 comp rx=0 tx=0).stop 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c1516d0 msgr2=0x7f203c14fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c1516d0 0x7f203c14fb70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20340af000 tx=0x7f203401bea0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 shutdown_connections 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f201c066550 0x7f201c068a10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203c1516d0 0x7f203c14fb70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f203c1512f0 0x7f203c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 --2- 172.21.15.133:0/1423586339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f203c0cbde0 0x7f203c0c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 >> 172.21.15.133:0/1423586339 conn(0x7f203c072890 msgr2=0x7f203c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 shutdown_connections 2024-01-19T04:32:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.433+0000 7f2041190640 1 -- 172.21.15.133:0/1423586339 wait complete. 2024-01-19T04:32:21.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476757 for osd.2 2024-01-19T04:32:21.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.477+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9aa80d30a0 con 0x7f9aa80dc460 2024-01-19T04:32:21.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.505+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe63006fb70 con 0x7fe6300c4ac0 2024-01-19T04:32:21.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.677+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f373c01b460 con 0x7f374c0c5db0 2024-01-19T04:32:21.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.677+0000 7f3741ffb640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3730066580 0x7f3730068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.677+0000 7f3751548640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3730066580 0x7f3730068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:21.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.677+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f373c055c50 con 0x7f374c0c5db0 2024-01-19T04:32:21.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.677+0000 7f3751548640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3730066580 0x7f3730068a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37480b2000 tx=0x7f3748004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.689+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbd280b3960 con 0x7fbd18003a20 2024-01-19T04:32:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.689+0000 7fbd227fc640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbd10066580 0x7fbd10068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.689+0000 7fbd315a3640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbd10066580 0x7fbd10068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.689+0000 7fbd315a3640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbd10066580 0x7fbd10068a40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c1556c0 tx=0x7fbd1c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.693+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd280efd50 con 0x7fbd18003a20 2024-01-19T04:32:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.705+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbd280ec090 con 0x7fbd18003a20 2024-01-19T04:32:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.709+0000 7f9a9bfff640 1 -- 172.21.15.133:0/811398344 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9aa80d30a0 con 0x7f9aa80dc460 2024-01-19T04:32:21.712 INFO:teuthology.orchestra.run.smithi133.stdout:64424509461 2024-01-19T04:32:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9a94066550 msgr2=0x7f9a94068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9a94066550 0x7f9a94068a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40b2000 tx=0x7f9aa4004740 comp rx=0 tx=0).stop 2024-01-19T04:32:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 msgr2=0x7f9aa80de450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 0x7f9aa80de450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0068710 tx=0x7f9ab004eef0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 shutdown_connections 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9a94066550 0x7f9a94068a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9aa80dc460 0x7f9aa80de450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa80d5dc0 0x7f9aa80dab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 --2- 172.21.15.133:0/811398344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9aa80464f0 0x7f9aa80d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 >> 172.21.15.133:0/811398344 conn(0x7f9aa80512a0 msgr2=0x7f9aa80d4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 shutdown_connections 2024-01-19T04:32:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.713+0000 7f9ab4c79640 1 -- 172.21.15.133:0/811398344 wait complete. 2024-01-19T04:32:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.717+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f373c051890 con 0x7f374c0c5db0 2024-01-19T04:32:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.721+0000 7fe626ffd640 1 -- 172.21.15.133:0/1927707250 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe618015070 con 0x7fe6300c4ac0 2024-01-19T04:32:21.723 INFO:teuthology.orchestra.run.smithi133.stdout:60129542165 2024-01-19T04:32:21.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe610066550 msgr2=0x7fe610068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe610066550 0x7fe610068a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6200b2000 tx=0x7fe620004740 comp rx=0 tx=0).stop 2024-01-19T04:32:21.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 msgr2=0x7fe630154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 0x7fe630154540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe61800b410 tx=0x7fe61800b8d0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 shutdown_connections 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe610066550 0x7fe610068a10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6300c4ac0 0x7fe630154540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6300c4f00 0x7fe630154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 --2- 172.21.15.133:0/1927707250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6300c2bc0 0x7fe6300c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 >> 172.21.15.133:0/1927707250 conn(0x7fe63006b770 msgr2=0x7fe6300c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 shutdown_connections 2024-01-19T04:32:21.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.725+0000 7fe634fdc640 1 -- 172.21.15.133:0/1927707250 wait complete. 2024-01-19T04:32:21.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509461 for osd.4 2024-01-19T04:32:21.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542165 for osd.7 2024-01-19T04:32:21.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.877+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd2c155710 con 0x7fbd18003a20 2024-01-19T04:32:21.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd227fc640 1 -- 172.21.15.133:0/78305242 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd2c155710 con 0x7fbd18003a20 2024-01-19T04:32:21.885 INFO:teuthology.orchestra.run.smithi133.stdout:68719476758 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbd10066580 msgr2=0x7fbd10068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbd10066580 0x7fbd10068a40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c1556c0 tx=0x7fbd1c009040 comp rx=0 tx=0).stop 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd18003a20 msgr2=0x7fbd2c157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd18003a20 0x7fbd2c157200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd280ad000 tx=0x7fbd18005800 comp rx=0 tx=0).stop 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 shutdown_connections 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbd10066580 0x7fbd10068a40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c156390 0x7fbd2c0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2c1f24c0 0x7fbd2c1ebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 --2- 172.21.15.133:0/78305242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd18003a20 0x7fbd2c157200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 >> 172.21.15.133:0/78305242 conn(0x7fbd2c06a660 msgr2=0x7fbd2c070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 shutdown_connections 2024-01-19T04:32:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7fbd34008640 1 -- 172.21.15.133:0/78305242 wait complete. 2024-01-19T04:32:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.885+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f374c159160 con 0x7f374c0c5db0 2024-01-19T04:32:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.897+0000 7f3741ffb640 1 -- 172.21.15.133:0/3557112737 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f373c054eb0 con 0x7f374c0c5db0 2024-01-19T04:32:21.900 INFO:teuthology.orchestra.run.smithi133.stdout:64424509462 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3730066580 msgr2=0x7f3730068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3730066580 0x7f3730068a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37480b2000 tx=0x7f3748004740 comp rx=0 tx=0).stop 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f374c0c5db0 msgr2=0x7f374c14a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f374c0c5db0 0x7f374c14a470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f373c00b3c0 tx=0x7f373c00b880 comp rx=0 tx=0).stop 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 shutdown_connections 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3730066580 0x7f3730068a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f374c0c5db0 0x7f374c14a470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f374c151740 0x7f374c06e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 --2- 172.21.15.133:0/3557112737 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f374c06ea80 0x7f374c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 >> 172.21.15.133:0/3557112737 conn(0x7f374c06b770 msgr2=0x7f374c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 shutdown_connections 2024-01-19T04:32:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:21.901+0000 7f37537ac640 1 -- 172.21.15.133:0/3557112737 wait complete. 2024-01-19T04:32:21.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476760 got 68719476758 for osd.1 2024-01-19T04:32:21.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.5 2024-01-19T04:32:22.293 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-19T04:32:22.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-19T04:32:22.410 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-19T04:32:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 Processor -- start 2024-01-19T04:32:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 -- start start 2024-01-19T04:32:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72601516d0 0x7f72600c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72600cbde0 0x7f72600c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72600c65a0 con 0x7f72601512f0 2024-01-19T04:32:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7260158450 con 0x7f72600cbde0 2024-01-19T04:32:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.433+0000 7f726710b640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726015ad60 con 0x7f72601516d0 2024-01-19T04:32:22.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-19T04:32:22.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.457+0000 7fc8b6614640 1 Processor -- start 2024-01-19T04:32:22.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.457+0000 7fc8b6614640 1 -- start start 2024-01-19T04:32:22.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.461+0000 7fc8b6614640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8b00c8160 0x7fc8b00c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.461+0000 7fc8b6614640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc8b00c8dc0 0x7fc8b015a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.461+0000 7fc8b6614640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b00c3200 con 0x7fc8b0151640 2024-01-19T04:32:22.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.461+0000 7fc8b6614640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00b0530 con 0x7fc8b00c8160 2024-01-19T04:32:22.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.461+0000 7fc8b6614640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00c9230 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.465+0000 7fc8affff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc8b0151640 0x7fc8b00ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60936/0 (socket says 172.21.15.133:60936) 2024-01-19T04:32:22.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.465+0000 7fc8affff640 1 -- 172.21.15.133:0/3457789241 learned_addr learned my addr 172.21.15.133:0/3457789241 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:22.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.465+0000 7f72656a8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72600cbde0 0x7f72600c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.465+0000 7f72656a8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72600cbde0 0x7f72600c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58516/0 (socket says 172.21.15.133:58516) 2024-01-19T04:32:22.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.465+0000 7f72656a8640 1 -- 172.21.15.133:0/3956906172 learned_addr learned my addr 172.21.15.133:0/3956906172 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.473+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/3457789241 >> v2:172.21.15.133:3300/0 conn(0x7fc8b00c8160 0x7fc8b00c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.473+0000 7f72656a8640 1 -- 172.21.15.133:0/3956906172 >> v2:172.21.15.156:3300/0 conn(0x7f72601516d0 msgr2=0x7f72600c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.473+0000 7f72656a8640 1 --2- 172.21.15.133:0/3956906172 >> v2:172.21.15.156:3300/0 conn(0x7f72601516d0 0x7f72600c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.473+0000 7f72656a8640 1 -- 172.21.15.133:0/3956906172 >> v1:172.21.15.156:6789/0 conn(0x7f72601512f0 legacy=0x7f726015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.473+0000 7f72656a8640 1 -- 172.21.15.133:0/3956906172 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260157650 con 0x7f72600cbde0 2024-01-19T04:32:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.481+0000 7f72656a8640 1 --2- 172.21.15.133:0/3956906172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72600cbde0 0x7f72600c57f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72600c9ad0 tx=0x7f725801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0418df85e9ca9da server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.481+0000 7fc8af7fe640 1 -- 172.21.15.133:0/3457789241 >> v2:172.21.15.156:3300/0 conn(0x7fc8b00c8dc0 msgr2=0x7fc8b015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.481+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/3457789241 >> v2:172.21.15.156:3300/0 conn(0x7fc8b00c8dc0 0x7fc8b015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.481+0000 7fc8af7fe640 1 -- 172.21.15.133:0/3457789241 >> v1:172.21.15.133:6789/0 conn(0x7fc8b0151640 legacy=0x7fc8b00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.481+0000 7fc8af7fe640 1 -- 172.21.15.133:0/3457789241 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b015b4f0 con 0x7fc8b00c8160 2024-01-19T04:32:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f725f7fe640 1 -- 172.21.15.133:0/3956906172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580af400 con 0x7f72600cbde0 2024-01-19T04:32:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f725f7fe640 1 -- 172.21.15.133:0/3956906172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72580ab050 con 0x7f72600cbde0 2024-01-19T04:32:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f725f7fe640 1 -- 172.21.15.133:0/3956906172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580af780 con 0x7f72600cbde0 2024-01-19T04:32:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/3457789241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8160 0x7fc8b00c3690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00b0d00 tx=0x7fc8a401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d87afb8b82538e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 -- 172.21.15.133:0/3956906172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72600cbde0 msgr2=0x7f72600c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 --2- 172.21.15.133:0/3956906172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72600cbde0 0x7f72600c57f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72600c9ad0 tx=0x7f725801f180 comp rx=0 tx=0).stop 2024-01-19T04:32:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 -- 172.21.15.133:0/3956906172 shutdown_connections 2024-01-19T04:32:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 --2- 172.21.15.133:0/3956906172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72600cbde0 0x7f72600c57f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 --2- 172.21.15.133:0/3956906172 >> v2:172.21.15.156:3300/0 conn(0x7f72601516d0 0x7f72600c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 -- 172.21.15.133:0/3956906172 >> 172.21.15.133:0/3956906172 conn(0x7f7260072890 msgr2=0x7f726006e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 -- 172.21.15.133:0/3956906172 shutdown_connections 2024-01-19T04:32:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 -- 172.21.15.133:0/3956906172 wait complete. 2024-01-19T04:32:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 Processor -- start 2024-01-19T04:32:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.493+0000 7f726710b640 1 -- start start 2024-01-19T04:32:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.497+0000 7f726710b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72600cbde0 0x7f726014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.497+0000 7f726710b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72601512f0 0x7f72601ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.497+0000 7f726710b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 0x7f72601edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.497+0000 7f726710b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601f0940 con 0x7f72601516d0 2024-01-19T04:32:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.497+0000 7f726710b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601f0b50 con 0x7f72600cbde0 2024-01-19T04:32:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.497+0000 7f726710b640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72601f0e30 con 0x7f72601512f0 2024-01-19T04:32:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8aeffd640 1 -- 172.21.15.133:0/3457789241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40a8950 con 0x7fc8b00c8160 2024-01-19T04:32:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8aeffd640 1 -- 172.21.15.133:0/3457789241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a40a8ab0 con 0x7fc8b00c8160 2024-01-19T04:32:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8aeffd640 1 -- 172.21.15.133:0/3457789241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40a8e40 con 0x7fc8b00c8160 2024-01-19T04:32:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/3457789241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8160 msgr2=0x7fc8b00c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/3457789241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8160 0x7fc8b00c3690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00b0d00 tx=0x7fc8a401ec50 comp rx=0 tx=0).stop 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/3457789241 shutdown_connections 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/3457789241 >> v2:172.21.15.156:3300/0 conn(0x7fc8b00c8dc0 0x7fc8b015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/3457789241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8160 0x7fc8b00c3690 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/3457789241 >> 172.21.15.133:0/3457789241 conn(0x7fc8b006a660 msgr2=0x7fc8b006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/3457789241 shutdown_connections 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/3457789241 wait complete. 2024-01-19T04:32:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7f72656a8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 0x7f72601edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7f72656a8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 0x7f72601edb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58534/0 (socket says 172.21.15.133:58534) 2024-01-19T04:32:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7f72656a8640 1 -- 172.21.15.133:0/2028798651 learned_addr learned my addr 172.21.15.133:0/2028798651 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 Processor -- start 2024-01-19T04:32:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 -- start start 2024-01-19T04:32:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7f725ffff640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72601512f0 0x7f72601ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00c8160 0x7fc8b0153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8dc0 0x7fc8b00c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0151640 0x7fc8b0149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014abf0 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0154620 con 0x7fc8b00c8160 2024-01-19T04:32:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.505+0000 7fc8b6614640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0154900 con 0x7fc8b0151640 2024-01-19T04:32:22.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.509+0000 7fc8b4bb1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0151640 0x7fc8b0149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.509+0000 7f72656a8640 1 -- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72601512f0 msgr2=0x7f72601ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.509+0000 7f72656a8640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72601512f0 0x7f72601ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.509+0000 7f72656a8640 1 -- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72600cbde0 msgr2=0x7f726014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.509+0000 7f72656a8640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72600cbde0 0x7f726014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.509+0000 7f72656a8640 1 -- 172.21.15.133:0/2028798651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7258009b30 con 0x7f72601516d0 2024-01-19T04:32:22.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.513+0000 7fc8b4bb1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0151640 0x7fc8b0149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:47986/0 (socket says 172.21.15.133:47986) 2024-01-19T04:32:22.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.513+0000 7fc8b4bb1640 1 -- 172.21.15.133:0/4235420106 learned_addr learned my addr 172.21.15.133:0/4235420106 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.513+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8dc0 0x7fc8b00c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.513+0000 7f72656a8640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 0x7f72601edb30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72580b2040 tx=0x7f725801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.521+0000 7fc8af7fe640 1 -- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0151640 msgr2=0x7fc8b0149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.521+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0151640 0x7fc8b0149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.521+0000 7fc8af7fe640 1 -- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00c8160 msgr2=0x7fc8b0153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.521+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00c8160 0x7fc8b0153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.521+0000 7fc8af7fe640 1 -- 172.21.15.133:0/4235420106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4009420 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.525+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580afde0 con 0x7f72601516d0 2024-01-19T04:32:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.525+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72580b8400 con 0x7f72601516d0 2024-01-19T04:32:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.525+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580b87b0 con 0x7f72601516d0 2024-01-19T04:32:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.525+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72601f1110 con 0x7f72601516d0 2024-01-19T04:32:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.525+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72600c2140 con 0x7f72601516d0 2024-01-19T04:32:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.525+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72601f15c0 con 0x7f72601516d0 2024-01-19T04:32:22.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.529+0000 7fc8af7fe640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8dc0 0x7fc8b00c9660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40af000 tx=0x7fc8a401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 Processor -- start 2024-01-19T04:32:22.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 -- start start 2024-01-19T04:32:22.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd30c0c4ea0 0x7fd30c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 0x7fd30c151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30c0c8ea0 con 0x7fd30c06b8b0 2024-01-19T04:32:22.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30c06bd40 con 0x7fd30c0c4ea0 2024-01-19T04:32:22.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd313dab640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0c88e0 con 0x7fd30c0c5280 2024-01-19T04:32:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.533+0000 7fd312348640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 0x7fd30c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.537+0000 7fd312348640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 0x7fd30c151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:47996/0 (socket says 172.21.15.133:47996) 2024-01-19T04:32:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.537+0000 7fd312348640 1 -- 172.21.15.133:0/71672813 learned_addr learned my addr 172.21.15.133:0/71672813 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.541+0000 7fd312348640 1 -- 172.21.15.133:0/71672813 >> v2:172.21.15.156:3300/0 conn(0x7fd30c0c4ea0 msgr2=0x7fd30c06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.541+0000 7fd312348640 1 --2- 172.21.15.133:0/71672813 >> v2:172.21.15.156:3300/0 conn(0x7fd30c0c4ea0 0x7fd30c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.541+0000 7fd312348640 1 -- 172.21.15.133:0/71672813 >> v1:172.21.15.133:6789/0 conn(0x7fd30c06b8b0 legacy=0x7fd30c15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.541+0000 7fd312348640 1 -- 172.21.15.133:0/71672813 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0c8bc0 con 0x7fd30c0c5280 2024-01-19T04:32:22.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.545+0000 7fd312348640 1 --2- 172.21.15.133:0/71672813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 0x7fd30c151110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd304009e50 tx=0x7fd30401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431b15a241e77242 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd310b45640 1 -- 172.21.15.133:0/71672813 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3040a5800 con 0x7fd30c0c5280 2024-01-19T04:32:22.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd310b45640 1 -- 172.21.15.133:0/71672813 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3040a5960 con 0x7fd30c0c5280 2024-01-19T04:32:22.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd310b45640 1 -- 172.21.15.133:0/71672813 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3040a5cf0 con 0x7fd30c0c5280 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 -- 172.21.15.133:0/71672813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 msgr2=0x7fd30c151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 --2- 172.21.15.133:0/71672813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 0x7fd30c151110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd304009e50 tx=0x7fd30401c9a0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 -- 172.21.15.133:0/71672813 shutdown_connections 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 --2- 172.21.15.133:0/71672813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c0c5280 0x7fd30c151110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 --2- 172.21.15.133:0/71672813 >> v2:172.21.15.156:3300/0 conn(0x7fd30c0c4ea0 0x7fd30c06a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 -- 172.21.15.133:0/71672813 >> 172.21.15.133:0/71672813 conn(0x7fd30c06fa20 msgr2=0x7fd30c0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 -- 172.21.15.133:0/71672813 shutdown_connections 2024-01-19T04:32:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.557+0000 7fd313dab640 1 -- 172.21.15.133:0/71672813 wait complete. 2024-01-19T04:32:22.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 Processor -- start 2024-01-19T04:32:22.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 -- start start 2024-01-19T04:32:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c0c4ea0 0x7fd30c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 0x7fd30c159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c1605f0 0x7fd30c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c158ca0 con 0x7fd30c0c4ea0 2024-01-19T04:32:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0c41c0 con 0x7fd30c0c5280 2024-01-19T04:32:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd313dab640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0cac50 con 0x7fd30c1605f0 2024-01-19T04:32:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd311346640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 0x7fd30c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd311346640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 0x7fd30c159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:38850/0 (socket says 172.21.15.133:38850) 2024-01-19T04:32:22.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.561+0000 7fd311346640 1 -- 172.21.15.133:0/3110154886 learned_addr learned my addr 172.21.15.133:0/3110154886 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.565+0000 7fd312348640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c1605f0 0x7fd30c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 Processor -- start 2024-01-19T04:32:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 -- start start 2024-01-19T04:32:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 0x7fe9dc15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9dc0c5280 0x7fe9dc15b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0c8ea0 con 0x7fe9dc0c4ea0 2024-01-19T04:32:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc06bd40 con 0x7fe9dc0c5280 2024-01-19T04:32:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.569+0000 7fe9e149a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c88e0 con 0x7fe9dc06b8b0 2024-01-19T04:32:22.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.573+0000 7fd311346640 1 -- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c1605f0 msgr2=0x7fd30c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.573+0000 7fd311346640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c1605f0 0x7fd30c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.573+0000 7fd311346640 1 -- 172.21.15.133:0/3110154886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c0c4ea0 msgr2=0x7fd30c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.573+0000 7fd311346640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c0c4ea0 0x7fd30c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.573+0000 7fd311346640 1 -- 172.21.15.133:0/3110154886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304009b30 con 0x7fd30c0c5280 2024-01-19T04:32:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.577+0000 7fe9da7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 0x7fe9dc15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.581+0000 7fd311346640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 0x7fd30c159290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c410 tx=0x7fd2fc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.581+0000 7fe9da7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 0x7fe9dc15b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48000/0 (socket says 172.21.15.133:48000) 2024-01-19T04:32:22.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.581+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1049466053 learned_addr learned my addr 172.21.15.133:0/1049466053 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1049466053 >> v2:172.21.15.133:3300/0 conn(0x7fe9dc0c5280 msgr2=0x7fe9dc15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fe9da7fc640 1 --2- 172.21.15.133:0/1049466053 >> v2:172.21.15.133:3300/0 conn(0x7fe9dc0c5280 0x7fe9dc15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1049466053 >> v1:172.21.15.133:6789/0 conn(0x7fe9dc0c4ea0 legacy=0x7fe9dc06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1049466053 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0c8bc0 con 0x7fe9dc06b8b0 2024-01-19T04:32:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc003600 con 0x7fd30c0c5280 2024-01-19T04:32:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc003780 con 0x7fd30c0c5280 2024-01-19T04:32:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c13e7e0 con 0x7fd30c0c5280 2024-01-19T04:32:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc003b30 con 0x7fd30c0c5280 2024-01-19T04:32:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.589+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c0ca840 con 0x7fd30c0c5280 2024-01-19T04:32:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.593+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c074340 con 0x7fd30c0c5280 2024-01-19T04:32:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.597+0000 7fe9da7fc640 1 --2- 172.21.15.133:0/1049466053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 0x7fe9dc15b1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009870 tx=0x7fe9cc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f1ff7c63b0e6a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9d9ffb640 1 -- 172.21.15.133:0/1049466053 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0aa610 con 0x7fe9dc06b8b0 2024-01-19T04:32:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9d9ffb640 1 -- 172.21.15.133:0/1049466053 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0a6040 con 0x7fe9dc06b8b0 2024-01-19T04:32:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9d9ffb640 1 -- 172.21.15.133:0/1049466053 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0aa990 con 0x7fe9dc06b8b0 2024-01-19T04:32:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- 172.21.15.133:0/1049466053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 msgr2=0x7fe9dc15b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1049466053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 0x7fe9dc15b1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009870 tx=0x7fe9cc01c4d0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- 172.21.15.133:0/1049466053 shutdown_connections 2024-01-19T04:32:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1049466053 >> v2:172.21.15.133:3300/0 conn(0x7fe9dc0c5280 0x7fe9dc15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1049466053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc06b8b0 0x7fe9dc15b1e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- 172.21.15.133:0/1049466053 >> 172.21.15.133:0/1049466053 conn(0x7fe9dc06fa20 msgr2=0x7fe9dc0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- 172.21.15.133:0/1049466053 shutdown_connections 2024-01-19T04:32:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- 172.21.15.133:0/1049466053 wait complete. 2024-01-19T04:32:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 Processor -- start 2024-01-19T04:32:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- start start 2024-01-19T04:32:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9dc0c4ea0 0x7fe9dc0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 0x7fe9dc13f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9dc0cac50 0x7fe9dc140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1454e0 con 0x7fe9dc0c4ea0 2024-01-19T04:32:22.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc14c580 con 0x7fe9dc0cac50 2024-01-19T04:32:22.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.609+0000 7fe9e149a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c99b0 con 0x7fe9dc0c5280 2024-01-19T04:32:22.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.613+0000 7fe9da7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 0x7fe9dc13f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.613+0000 7fe9da7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 0x7fe9dc13f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48002/0 (socket says 172.21.15.133:48002) 2024-01-19T04:32:22.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.613+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1327273189 learned_addr learned my addr 172.21.15.133:0/1327273189 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.625+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9dc0cac50 msgr2=0x7fe9dc140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.625+0000 7fe9da7fc640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9dc0cac50 0x7fe9dc140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.625+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1327273189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9dc0c4ea0 msgr2=0x7fe9dc0ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.625+0000 7fe9da7fc640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9dc0c4ea0 0x7fe9dc0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.625+0000 7fe9da7fc640 1 -- 172.21.15.133:0/1327273189 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0094d0 con 0x7fe9dc0c5280 2024-01-19T04:32:22.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.633+0000 7fe9da7fc640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 0x7fe9dc13f1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc01cd70 tx=0x7fe9cc01ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.641+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0b3800 con 0x7fe9dc0c5280 2024-01-19T04:32:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.641+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0b3980 con 0x7fe9dc0c5280 2024-01-19T04:32:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.641+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0b3d30 con 0x7fe9dc0c5280 2024-01-19T04:32:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.641+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc145200 con 0x7fe9dc0c5280 2024-01-19T04:32:22.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.641+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc14baa0 con 0x7fe9dc0c5280 2024-01-19T04:32:22.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.645+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc074340 con 0x7fe9dc0c5280 2024-01-19T04:32:22.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-19T04:32:22.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-19T04:32:22.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.789+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f72580b6040 con 0x7f72601516d0 2024-01-19T04:32:22.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.789+0000 7f725d7fa640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f724c066500 0x7f724c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.789+0000 7f7264ea7640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f724c066500 0x7f724c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.793+0000 7f7264ea7640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f724c066500 0x7f724c0689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7254009650 tx=0x7f7254006bb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.813+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72580f40a0 con 0x7f72601516d0 2024-01-19T04:32:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.813+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f72580efce0 con 0x7f72601516d0 2024-01-19T04:32:22.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.857+0000 7f0d1bff9640 1 Processor -- start 2024-01-19T04:32:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.861+0000 7f0d1bff9640 1 -- start start 2024-01-19T04:32:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.861+0000 7f0d1bff9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 0x7f0d140c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.861+0000 7f0d1bff9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d140c6a90 con 0x7f0d140c2bc0 2024-01-19T04:32:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.861+0000 7f0d1bff9640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1406e000 con 0x7f0d14153a90 2024-01-19T04:32:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.861+0000 7f0d1bff9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140c1330 con 0x7f0d141536b0 2024-01-19T04:32:22.905 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-19T04:32:22.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-19T04:32:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f0d1a596640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0d140c2bc0 0x7f0d140c8790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60968/0 (socket says 172.21.15.133:60968) 2024-01-19T04:32:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f0d1a596640 1 -- 172.21.15.133:0/1308394719 learned_addr learned my addr 172.21.15.133:0/1308394719 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 Processor -- start 2024-01-19T04:32:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 -- start start 2024-01-19T04:32:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181516d0 0x7f89180c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89180cbde0 0x7f89180c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89180c65a0 con 0x7f89181512f0 2024-01-19T04:32:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8918158450 con 0x7f89180cbde0 2024-01-19T04:32:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.925+0000 7f891fe1f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891815ad60 con 0x7f89181516d0 2024-01-19T04:32:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40bf070 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a40b0c80 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40b9410 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b0154be0 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b01ee990 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b0074340 con 0x7fc8b00c8dc0 2024-01-19T04:32:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd2fc003c90 con 0x7fd30c0c5280 2024-01-19T04:32:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fd3027fc640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd2f0066500 0x7fd2f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.929+0000 7fd311b47640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd2f0066500 0x7fd2f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.933+0000 7fd311b47640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd2f0066500 0x7fd2f00689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd308009730 tx=0x7fd308006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.941+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729574871 0 0) 0x7f0d140c6a90 con 0x7f0d140c2bc0 2024-01-19T04:32:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.941+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d00003530 con 0x7f0d140c2bc0 2024-01-19T04:32:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2fc0010f0 con 0x7fd30c0c5280 2024-01-19T04:32:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f891e3bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89180cbde0 0x7f89180c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175123450 0 0) 0x7f0d00003530 con 0x7f0d140c2bc0 2024-01-19T04:32:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 msgr2=0x7f0d140c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 0x7f0d140c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 >> v1:172.21.15.156:6789/0 conn(0x7f0d14153a90 legacy=0x7f0d1406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1406e2e0 con 0x7f0d140c2bc0 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f0d10001680 con 0x7f0d140c2bc0 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 >> v1:172.21.15.133:6789/0 conn(0x7f0d140c2bc0 legacy=0x7f0d140c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 0x7f0d00003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00004160 0x7f0d000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d00004e30 0x7f0d0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00005610 con 0x7f0d00004e30 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0000bed0 con 0x7f0d00004160 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0000c040 con 0x7f0d141536b0 2024-01-19T04:32:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f891e3bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89180cbde0 0x7f89180c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58584/0 (socket says 172.21.15.133:58584) 2024-01-19T04:32:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.945+0000 7f891e3bc640 1 -- 172.21.15.133:0/1436044848 learned_addr learned my addr 172.21.15.133:0/1436044848 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.953+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe9cc0c63c0 con 0x7fe9dc0c5280 2024-01-19T04:32:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.953+0000 7fe9c37fe640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe9c8066580 0x7fe9c8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.953+0000 7fe9daffd640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe9c8066580 0x7fe9c8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.957+0000 7fe9daffd640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe9c8066580 0x7fe9c8068a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0007fd0 tx=0x7fe9d00079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:22.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.957+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9cc0f0270 con 0x7fe9dc0c5280 2024-01-19T04:32:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.957+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd2fc050f40 con 0x7fd30c0c5280 2024-01-19T04:32:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.957+0000 7f0d19594640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00004160 0x7f0d000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:22.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.973+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe9cc0ebeb0 con 0x7fe9dc0c5280 2024-01-19T04:32:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.981+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f72601f15c0 con 0x7f72601516d0 2024-01-19T04:32:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:22.981+0000 7f0d19d95640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 0x7f0d00003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 Processor -- start 2024-01-19T04:32:23.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 -- start start 2024-01-19T04:32:23.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea740716d0 0x7fea74159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fea740cba20 0x7fea740c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7415a4f0 con 0x7fea74071ab0 2024-01-19T04:32:23.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea740cbef0 con 0x7fea740716d0 2024-01-19T04:32:23.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.017+0000 7fea79859640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7415cb20 con 0x7fea740cba20 2024-01-19T04:32:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.045+0000 7f0d19594640 1 -- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 msgr2=0x7f0d00003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.045+0000 7f0d19594640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d141536b0 0x7f0d00003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.045+0000 7f0d19594640 1 -- 172.21.15.133:0/1308394719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d00004e30 msgr2=0x7f0d0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.045+0000 7f0d19594640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d00004e30 0x7f0d0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.045+0000 7f0d19594640 1 -- 172.21.15.133:0/1308394719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00003530 con 0x7f0d00004160 2024-01-19T04:32:23.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.049+0000 7f891d3ba640 1 --2- 172.21.15.133:0/1436044848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181516d0 0x7f89180c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.057+0000 7fea727fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fea740cba20 0x7fea740c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.057+0000 7fe23c0c0640 1 Processor -- start 2024-01-19T04:32:23.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.057+0000 7fe23c0c0640 1 -- start start 2024-01-19T04:32:23.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fe23c0c0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe23414fc80 0x7fe234159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fe23c0c0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2340c46c0 0x7fe2340c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fe23c0c0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340c28e0 con 0x7fe2340c5de0 2024-01-19T04:32:23.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fe23c0c0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe234159740 con 0x7fe23414fc80 2024-01-19T04:32:23.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fe23c0c0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2340c7c20 con 0x7fe2340c46c0 2024-01-19T04:32:23.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fea727fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fea740cba20 0x7fea740c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:38866/0 (socket says 172.21.15.133:38866) 2024-01-19T04:32:23.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.061+0000 7fea727fc640 1 -- 172.21.15.133:0/1191521612 learned_addr learned my addr 172.21.15.133:0/1191521612 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:23.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.069+0000 7f0d19594640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00004160 0x7f0d000047d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001650 tx=0x7f0d0401c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c202172d2694bcf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.073+0000 7fea727fc640 1 -- 172.21.15.133:0/1191521612 >> v2:172.21.15.133:3300/0 conn(0x7fea740716d0 msgr2=0x7fea74159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.073+0000 7fea727fc640 1 --2- 172.21.15.133:0/1191521612 >> v2:172.21.15.133:3300/0 conn(0x7fea740716d0 0x7fea74159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.073+0000 7fea727fc640 1 -- 172.21.15.133:0/1191521612 >> v1:172.21.15.133:6789/0 conn(0x7fea74071ab0 legacy=0x7fea74152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.073+0000 7fea727fc640 1 -- 172.21.15.133:0/1191521612 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7415ce00 con 0x7fea740cba20 2024-01-19T04:32:23.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.077+0000 7f891d3ba640 1 -- 172.21.15.133:0/1436044848 >> v2:172.21.15.133:3300/0 conn(0x7f89180cbde0 msgr2=0x7f89180c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.077+0000 7f891d3ba640 1 --2- 172.21.15.133:0/1436044848 >> v2:172.21.15.133:3300/0 conn(0x7f89180cbde0 0x7f89180c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.077+0000 7f891d3ba640 1 -- 172.21.15.133:0/1436044848 >> v1:172.21.15.156:6789/0 conn(0x7f89181512f0 legacy=0x7f891815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.077+0000 7f891d3ba640 1 -- 172.21.15.133:0/1436044848 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918157650 con 0x7f89181516d0 2024-01-19T04:32:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.081+0000 7fea727fc640 1 --2- 172.21.15.133:0/1191521612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740cba20 0x7fea740c3e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea68009870 tx=0x7fea6801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f8f3b448af9f25 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.089+0000 7f891d3ba640 1 --2- 172.21.15.133:0/1436044848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181516d0 0x7f89180c52b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89080097c0 tx=0x7f890801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=868a98765016c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.089+0000 7fea71ffb640 1 -- 172.21.15.133:0/1191521612 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680a89b0 con 0x7fea740cba20 2024-01-19T04:32:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.089+0000 7fea71ffb640 1 -- 172.21.15.133:0/1191521612 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea680a8b10 con 0x7fea740cba20 2024-01-19T04:32:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.089+0000 7fea71ffb640 1 -- 172.21.15.133:0/1191521612 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680a8ea0 con 0x7fea740cba20 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- 172.21.15.133:0/1191521612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740cba20 msgr2=0x7fea740c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 --2- 172.21.15.133:0/1191521612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740cba20 0x7fea740c3e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea68009870 tx=0x7fea6801ecb0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- 172.21.15.133:0/1191521612 shutdown_connections 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 --2- 172.21.15.133:0/1191521612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea740cba20 0x7fea740c3e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 --2- 172.21.15.133:0/1191521612 >> v2:172.21.15.133:3300/0 conn(0x7fea740716d0 0x7fea74159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- 172.21.15.133:0/1191521612 >> 172.21.15.133:0/1191521612 conn(0x7fea74066a60 msgr2=0x7fea7406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- 172.21.15.133:0/1191521612 shutdown_connections 2024-01-19T04:32:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- 172.21.15.133:0/1191521612 wait complete. 2024-01-19T04:32:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fe23a65d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2340c46c0 0x7fe2340c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04005270 con 0x7f0d00004160 2024-01-19T04:32:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d040a7070 con 0x7f0d00004160 2024-01-19T04:32:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d18d93640 1 -- 172.21.15.133:0/1308394719 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04003860 con 0x7f0d00004160 2024-01-19T04:32:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 Processor -- start 2024-01-19T04:32:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- start start 2024-01-19T04:32:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00004160 msgr2=0x7f0d000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1308394719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00004160 0x7f0d000047d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001650 tx=0x7f0d0401c2e0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1a596640 1 -- 172.21.15.133:0/1308394719 reap_dead start 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1308394719 shutdown_connections 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1308394719 >> 172.21.15.133:0/1308394719 conn(0x7f0d1406b770 msgr2=0x7f0d1406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1308394719 shutdown_connections 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 0x7fea741f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea74071ab0 0x7fea7415b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea740cba20 0x7fea74148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7415bba0 con 0x7fea740cba20 2024-01-19T04:32:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7414aef0 con 0x7fea74071ab0 2024-01-19T04:32:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fea79859640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7414eb00 con 0x7fea740716d0 2024-01-19T04:32:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1308394719 wait complete. 2024-01-19T04:32:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891cbb9640 1 -- 172.21.15.133:0/1436044848 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080ad640 con 0x7f89181516d0 2024-01-19T04:32:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891cbb9640 1 -- 172.21.15.133:0/1436044848 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89080ad7a0 con 0x7f89181516d0 2024-01-19T04:32:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891cbb9640 1 -- 172.21.15.133:0/1436044848 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080adb30 con 0x7f89181516d0 2024-01-19T04:32:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fe23a65d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2340c46c0 0x7fe2340c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:38878/0 (socket says 172.21.15.133:38878) 2024-01-19T04:32:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7fe23a65d640 1 -- 172.21.15.133:0/1430779293 learned_addr learned my addr 172.21.15.133:0/1430779293 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891fe1f640 1 -- 172.21.15.133:0/1436044848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181516d0 msgr2=0x7f89180c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1436044848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181516d0 0x7f89180c52b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89080097c0 tx=0x7f890801c480 comp rx=0 tx=0).stop 2024-01-19T04:32:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 Processor -- start 2024-01-19T04:32:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891fe1f640 1 -- 172.21.15.133:0/1436044848 shutdown_connections 2024-01-19T04:32:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1436044848 >> v2:172.21.15.133:3300/0 conn(0x7f89180cbde0 0x7f89180c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1436044848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181516d0 0x7f89180c52b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f891fe1f640 1 -- 172.21.15.133:0/1436044848 >> 172.21.15.133:0/1436044848 conn(0x7f8918072890 msgr2=0x7f891806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.093+0000 7f0d1bff9640 1 -- start start 2024-01-19T04:32:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 -- 172.21.15.133:0/1436044848 shutdown_connections 2024-01-19T04:32:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 -- 172.21.15.133:0/1436044848 wait complete. 2024-01-19T04:32:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f0d1bff9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d00004160 0x7f0d141f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f0d1bff9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 0x7f0d140cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f0d1bff9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d1413f0e0 0x7f0d1413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f0d1bff9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14145070 con 0x7f0d1413f0e0 2024-01-19T04:32:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f0d1bff9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141455f0 con 0x7f0d140ca850 2024-01-19T04:32:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f0d1bff9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14145310 con 0x7f0d00004160 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 Processor -- start 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 -- start start 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89180cbde0 0x7f8918156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 0x7f89180c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89181516d0 0x7f89180ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891813fbe0 con 0x7f89181516d0 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8918158820 con 0x7f89180cbde0 2024-01-19T04:32:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.097+0000 7f891fe1f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891813fe30 con 0x7f89181512f0 2024-01-19T04:32:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.101+0000 7f891d3ba640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 0x7f89180c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.101+0000 7fea72ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 0x7fea741f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.105+0000 7f891d3ba640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 0x7f89180c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48058/0 (socket says 172.21.15.133:48058) 2024-01-19T04:32:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.105+0000 7f891d3ba640 1 -- 172.21.15.133:0/1557951469 learned_addr learned my addr 172.21.15.133:0/1557951469 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.105+0000 7fea72ffd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 0x7fea741f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48036/0 (socket says 172.21.15.133:48036) 2024-01-19T04:32:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.105+0000 7fea72ffd640 1 -- 172.21.15.133:0/3730517274 learned_addr learned my addr 172.21.15.133:0/3730517274 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.105+0000 7fea727fc640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea74071ab0 0x7fea7415b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.105+0000 7f0d19594640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 0x7f0d140cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.109+0000 7fe23a65d640 1 -- 172.21.15.133:0/1430779293 >> v2:172.21.15.133:3300/0 conn(0x7fe23414fc80 msgr2=0x7fe234159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.109+0000 7fe23a65d640 1 --2- 172.21.15.133:0/1430779293 >> v2:172.21.15.133:3300/0 conn(0x7fe23414fc80 0x7fe234159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.109+0000 7fe23a65d640 1 -- 172.21.15.133:0/1430779293 >> v1:172.21.15.156:6789/0 conn(0x7fe2340c5de0 legacy=0x7fe2340c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.109+0000 7fe23a65d640 1 -- 172.21.15.133:0/1430779293 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234159130 con 0x7fe2340c46c0 2024-01-19T04:32:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.109+0000 7f0d19594640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 0x7f0d140cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:38894/0 (socket says 172.21.15.133:38894) 2024-01-19T04:32:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.109+0000 7f0d19594640 1 -- 172.21.15.133:0/1448784876 learned_addr learned my addr 172.21.15.133:0/1448784876 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.113+0000 7f891d3ba640 1 -- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89180cbde0 msgr2=0x7f8918156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.113+0000 7f891d3ba640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89180cbde0 0x7f8918156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.113+0000 7f891d3ba640 1 -- 172.21.15.133:0/1557951469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89181516d0 msgr2=0x7f89180ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.113+0000 7f891d3ba640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89181516d0 0x7f89180ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.113+0000 7f891d3ba640 1 -- 172.21.15.133:0/1557951469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8908009420 con 0x7f89181512f0 2024-01-19T04:32:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.121+0000 7fea72ffd640 1 -- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea74071ab0 msgr2=0x7fea7415b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.121+0000 7fea72ffd640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea74071ab0 0x7fea7415b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.121+0000 7fea72ffd640 1 -- 172.21.15.133:0/3730517274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea740cba20 msgr2=0x7fea74148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.121+0000 7fea72ffd640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea740cba20 0x7fea74148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.121+0000 7fea72ffd640 1 -- 172.21.15.133:0/3730517274 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680094d0 con 0x7fea740716d0 2024-01-19T04:32:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.125+0000 7fe23a65d640 1 --2- 172.21.15.133:0/1430779293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2340c46c0 0x7fe2340c4b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2340c45e0 tx=0x7fe22c01c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b96b5fd98b2f9f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.129+0000 7fea72ffd640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 0x7fea741f0490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b550 tx=0x7fea6400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.129+0000 7f891d3ba640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 0x7f89180c20f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f890801ab30 tx=0x7f8908019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.133+0000 7f0d19594640 1 -- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d00004160 msgr2=0x7f0d141f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.133+0000 7f0d19594640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d00004160 0x7f0d141f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.133+0000 7f0d19594640 1 -- 172.21.15.133:0/1448784876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d1413f0e0 msgr2=0x7f0d1413f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.133+0000 7f0d19594640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d1413f0e0 0x7f0d1413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.133+0000 7f0d19594640 1 -- 172.21.15.133:0/1448784876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1415af00 con 0x7f0d140ca850 2024-01-19T04:32:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.153+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64010870 con 0x7fea740716d0 2024-01-19T04:32:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.153+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea640109f0 con 0x7fea740716d0 2024-01-19T04:32:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.153+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64010da0 con 0x7fea740716d0 2024-01-19T04:32:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.153+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7415abc0 con 0x7fea740716d0 2024-01-19T04:32:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.153+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7415ae60 con 0x7fea740716d0 2024-01-19T04:32:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.153+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea74074340 con 0x7fea740716d0 2024-01-19T04:32:23.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd30c0c7950 con 0x7fd30c0c5280 2024-01-19T04:32:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080b8830 con 0x7f89181512f0 2024-01-19T04:32:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89080a6040 con 0x7f89181512f0 2024-01-19T04:32:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080b8bf0 con 0x7f89181512f0 2024-01-19T04:32:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8918140110 con 0x7f89181512f0 2024-01-19T04:32:23.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89180c9e80 con 0x7f89181512f0 2024-01-19T04:32:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f0d19594640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 0x7f0d140cacb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001650 tx=0x7f0d00005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.157+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89180ca070 con 0x7f89181512f0 2024-01-19T04:32:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe238e5a640 1 -- 172.21.15.133:0/1430779293 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0a56c0 con 0x7fe2340c46c0 2024-01-19T04:32:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe238e5a640 1 -- 172.21.15.133:0/1430779293 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c0a5820 con 0x7fe2340c46c0 2024-01-19T04:32:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe238e5a640 1 -- 172.21.15.133:0/1430779293 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0a5bb0 con 0x7fe2340c46c0 2024-01-19T04:32:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1430779293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2340c46c0 msgr2=0x7fe2340c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1430779293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2340c46c0 0x7fe2340c4b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2340c45e0 tx=0x7fe22c01c990 comp rx=0 tx=0).stop 2024-01-19T04:32:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1430779293 shutdown_connections 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1430779293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2340c46c0 0x7fe2340c4b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1430779293 >> v2:172.21.15.133:3300/0 conn(0x7fe23414fc80 0x7fe234159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1430779293 >> 172.21.15.133:0/1430779293 conn(0x7fe2340cb3e0 msgr2=0x7fe2340cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1430779293 shutdown_connections 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.161+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1430779293 wait complete. 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 Processor -- start 2024-01-19T04:32:23.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 -- start start 2024-01-19T04:32:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2340c46c0 0x7fe2341f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2340c5de0 0x7fe23414ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 0x7fe234146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2341f1580 con 0x7fe2340c5de0 2024-01-19T04:32:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23414b8f0 con 0x7fe23414fc80 2024-01-19T04:32:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.165+0000 7fe23c0c0640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23414bb90 con 0x7fe2340c46c0 2024-01-19T04:32:23.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.181+0000 7fe23a65d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 0x7fe234146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.185+0000 7fe23a65d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 0x7fe234146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:38914/0 (socket says 172.21.15.133:38914) 2024-01-19T04:32:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.185+0000 7fe23a65d640 1 -- 172.21.15.133:0/1459955839 learned_addr learned my addr 172.21.15.133:0/1459955839 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.193+0000 7fe23a65d640 1 -- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2340c46c0 msgr2=0x7fe2341f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.193+0000 7fe23a65d640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2340c46c0 0x7fe2341f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.193+0000 7fe23a65d640 1 -- 172.21.15.133:0/1459955839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2340c5de0 msgr2=0x7fe23414ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.193+0000 7fe23a65d640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2340c5de0 0x7fe23414ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.193+0000 7fe23a65d640 1 -- 172.21.15.133:0/1459955839 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c009b30 con 0x7fe23414fc80 2024-01-19T04:32:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.193+0000 7fd3027fc640 1 -- 172.21.15.133:0/3110154886 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2fc021020 con 0x7fd30c0c5280 2024-01-19T04:32:23.196 INFO:teuthology.orchestra.run.smithi133.stdout:64424509463 2024-01-19T04:32:23.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd2f0066500 msgr2=0x7fd2f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd2f0066500 0x7fd2f00689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd308009730 tx=0x7fd308006ca0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 msgr2=0x7fd30c159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 0x7fd30c159290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c410 tx=0x7fd2fc00c8d0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 shutdown_connections 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd2f0066500 0x7fd2f00689c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd30c0c5280 0x7fd30c159290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd30c1605f0 0x7fd30c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 --2- 172.21.15.133:0/3110154886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c0c4ea0 0x7fd30c1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 >> 172.21.15.133:0/3110154886 conn(0x7fd30c06fa20 msgr2=0x7fd30c0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 shutdown_connections 2024-01-19T04:32:23.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.197+0000 7fd313dab640 1 -- 172.21.15.133:0/3110154886 wait complete. 2024-01-19T04:32:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.201+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d040b3070 con 0x7f0d140ca850 2024-01-19T04:32:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.201+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04007240 con 0x7f0d140ca850 2024-01-19T04:32:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.201+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d040075d0 con 0x7f0d140ca850 2024-01-19T04:32:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.201+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14144d30 con 0x7f0d140ca850 2024-01-19T04:32:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.201+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d141444c0 con 0x7f0d140ca850 2024-01-19T04:32:23.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.201+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d14074340 con 0x7f0d140ca850 2024-01-19T04:32:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.205+0000 7fe23a65d640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 0x7fe234146f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe22c01a5c0 tx=0x7fe22c019730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.3 2024-01-19T04:32:23.224 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:23.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.225+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9dc06a8b0 con 0x7fe9dc0c5280 2024-01-19T04:32:23.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.281+0000 7f725d7fa640 1 -- 172.21.15.133:0/2028798651 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72601f15c0 con 0x7f72601516d0 2024-01-19T04:32:23.283 INFO:teuthology.orchestra.run.smithi133.stdout:64424509463 2024-01-19T04:32:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f724c066500 msgr2=0x7f724c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f724c066500 0x7f724c0689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7254009650 tx=0x7f7254006bb0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 msgr2=0x7f72601edb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 0x7f72601edb30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72580b2040 tx=0x7f725801bf20 comp rx=0 tx=0).stop 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 shutdown_connections 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f724c066500 0x7f724c0689c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72601516d0 0x7f72601edb30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72601512f0 0x7f72601ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 --2- 172.21.15.133:0/2028798651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72600cbde0 0x7f726014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 >> 172.21.15.133:0/2028798651 conn(0x7f7260072890 msgr2=0x7f726006e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 shutdown_connections 2024-01-19T04:32:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.285+0000 7f726710b640 1 -- 172.21.15.133:0/2028798651 wait complete. 2024-01-19T04:32:23.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.6 2024-01-19T04:32:23.302 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:23.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.321+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc8a40b7040 con 0x7fc8b00c8dc0 2024-01-19T04:32:23.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.321+0000 7fc8acff9640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc89c066500 0x7fc89c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.321+0000 7fc8affff640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc89c066500 0x7fc89c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.321+0000 7fc8affff640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc89c066500 0x7fc89c0689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000f70 tx=0x7fc8a0007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.333+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc8a40f3380 con 0x7fc8b00c8dc0 2024-01-19T04:32:23.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.333+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc8a40eefc0 con 0x7fc8b00c8dc0 2024-01-19T04:32:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.493+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8b00c3f30 con 0x7fc8b00c8dc0 2024-01-19T04:32:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.497+0000 7fc8acff9640 1 -- 172.21.15.133:0/4235420106 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8a40f25e0 con 0x7fc8b00c8dc0 2024-01-19T04:32:23.499 INFO:teuthology.orchestra.run.smithi133.stdout:60129542166 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc89c066500 msgr2=0x7fc89c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc89c066500 0x7fc89c0689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000f70 tx=0x7fc8a0007a90 comp rx=0 tx=0).stop 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8dc0 msgr2=0x7fc8b00c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8dc0 0x7fc8b00c9660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40af000 tx=0x7fc8a401b9f0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 shutdown_connections 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc89c066500 0x7fc89c0689c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0151640 0x7fc8b0149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b00c8dc0 0x7fc8b00c9660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 --2- 172.21.15.133:0/4235420106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b00c8160 0x7fc8b0153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 >> 172.21.15.133:0/4235420106 conn(0x7fc8b006a660 msgr2=0x7fc8b0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 shutdown_connections 2024-01-19T04:32:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.501+0000 7fc8b6614640 1 -- 172.21.15.133:0/4235420106 wait complete. 2024-01-19T04:32:23.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542166 for osd.0 2024-01-19T04:32:23.518 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:23.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.521+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0d040a9020 con 0x7f0d140ca850 2024-01-19T04:32:23.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.521+0000 7f0d0a7fc640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0cf8066530 0x7f0cf80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.521+0000 7f0d19d95640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0cf8066530 0x7f0cf80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.525+0000 7f0d19d95640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0cf8066530 0x7f0cf80689f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009f50 tx=0x7f0d0c009a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.529+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d040eeda0 con 0x7f0d140ca850 2024-01-19T04:32:23.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.545+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0d040ea9e0 con 0x7f0d140ca850 2024-01-19T04:32:23.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.557+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0b8670 con 0x7fe23414fc80 2024-01-19T04:32:23.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.557+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c0b87d0 con 0x7fe23414fc80 2024-01-19T04:32:23.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.557+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23414be70 con 0x7fe23414fc80 2024-01-19T04:32:23.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.557+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0b8bc0 con 0x7fe23414fc80 2024-01-19T04:32:23.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.557+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2340c94c0 con 0x7fe23414fc80 2024-01-19T04:32:23.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.557+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe234074340 con 0x7fe23414fc80 2024-01-19T04:32:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.697+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d1406fb70 con 0x7f0d140ca850 2024-01-19T04:32:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.805+0000 7fe9c37fe640 1 -- 172.21.15.133:0/1327273189 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9cc0ef4d0 con 0x7fe9dc0c5280 2024-01-19T04:32:23.807 INFO:teuthology.orchestra.run.smithi133.stdout:68719476759 2024-01-19T04:32:23.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe9c8066580 msgr2=0x7fe9c8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe9c8066580 0x7fe9c8068a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0007fd0 tx=0x7fe9d00079a0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 msgr2=0x7fe9dc13f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 0x7fe9dc13f1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc01cd70 tx=0x7fe9cc01ad10 comp rx=0 tx=0).stop 2024-01-19T04:32:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 shutdown_connections 2024-01-19T04:32:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe9c8066580 0x7fe9c8068a40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9dc0cac50 0x7fe9dc140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9dc0c5280 0x7fe9dc13f1e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 --2- 172.21.15.133:0/1327273189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9dc0c4ea0 0x7fe9dc0ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 >> 172.21.15.133:0/1327273189 conn(0x7fe9dc06fa20 msgr2=0x7fe9dc15b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 shutdown_connections 2024-01-19T04:32:23.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.809+0000 7fe9e149a640 1 -- 172.21.15.133:0/1327273189 wait complete. 2024-01-19T04:32:23.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.2 2024-01-19T04:32:23.828 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:23.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.841+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fea64023480 con 0x7fea740716d0 2024-01-19T04:32:23.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.845+0000 7fea5bfff640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fea60066580 0x7fea60068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.845+0000 7fea727fc640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fea60066580 0x7fea60068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.845+0000 7fea727fc640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fea60066580 0x7fea60068a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea680b2000 tx=0x7fea68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.849+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea640552c0 con 0x7fea740716d0 2024-01-19T04:32:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.909+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f89080b4040 con 0x7f89181512f0 2024-01-19T04:32:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.909+0000 7f890e7fc640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f88fc066500 0x7f88fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.909+0000 7f891dbbb640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f88fc066500 0x7f88fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.909+0000 7f891dbbb640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f88fc066500 0x7f88fc0689c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8914000f70 tx=0x7f89140079e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.909+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89080b5e40 con 0x7f89181512f0 2024-01-19T04:32:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.929+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f89080ec260 con 0x7f89181512f0 2024-01-19T04:32:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.933+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fea64051600 con 0x7fea740716d0 2024-01-19T04:32:23.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.977+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe22c0b8d20 con 0x7fe23414fc80 2024-01-19T04:32:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.977+0000 7fe22a7fc640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe218066550 0x7fe218068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:23.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.981+0000 7fe239e5c640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe218066550 0x7fe218068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:23.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.981+0000 7fe239e5c640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe218066550 0x7fe218068a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe230009730 tx=0x7fe230006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:23.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:23.997+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe22c0f0f40 con 0x7fe23414fc80 2024-01-19T04:32:24.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d0a7fc640 1 -- 172.21.15.133:0/1448784876 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d040ee000 con 0x7f0d140ca850 2024-01-19T04:32:24.034 INFO:teuthology.orchestra.run.smithi133.stdout:64424509462 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0cf8066530 msgr2=0x7f0cf80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0cf8066530 0x7f0cf80689f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009f50 tx=0x7f0d0c009a10 comp rx=0 tx=0).stop 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 msgr2=0x7f0d140cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 0x7f0d140cacb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001650 tx=0x7f0d00005800 comp rx=0 tx=0).stop 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 shutdown_connections 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0cf8066530 0x7f0cf80689f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d140ca850 0x7f0d140cacb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d1413f0e0 0x7f0d1413f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 --2- 172.21.15.133:0/1448784876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d00004160 0x7f0d141f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 >> 172.21.15.133:0/1448784876 conn(0x7f0d1406b770 msgr2=0x7f0d141485c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 shutdown_connections 2024-01-19T04:32:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.033+0000 7f0d1bff9640 1 -- 172.21.15.133:0/1448784876 wait complete. 2024-01-19T04:32:24.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.037+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe22c0ecb80 con 0x7fe23414fc80 2024-01-19T04:32:24.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.4 2024-01-19T04:32:24.053 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:24.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.133+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8918074340 con 0x7f89181512f0 2024-01-19T04:32:24.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.173+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea740c2560 con 0x7fea740716d0 2024-01-19T04:32:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.209+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe2340c3ea0 con 0x7fe23414fc80 2024-01-19T04:32:24.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.245+0000 7f890e7fc640 1 -- 172.21.15.133:0/1557951469 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89080b2070 con 0x7f89181512f0 2024-01-19T04:32:24.247 INFO:teuthology.orchestra.run.smithi133.stdout:60129542166 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f88fc066500 msgr2=0x7f88fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f88fc066500 0x7f88fc0689c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8914000f70 tx=0x7f89140079e0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 msgr2=0x7f89180c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 0x7f89180c20f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f890801ab30 tx=0x7f8908019220 comp rx=0 tx=0).stop 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 shutdown_connections 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f88fc066500 0x7f88fc0689c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89181516d0 0x7f89180ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89181512f0 0x7f89180c20f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 --2- 172.21.15.133:0/1557951469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89180cbde0 0x7f8918156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 >> 172.21.15.133:0/1557951469 conn(0x7f8918072890 msgr2=0x7f89180c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 shutdown_connections 2024-01-19T04:32:24.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.249+0000 7f891fe1f640 1 -- 172.21.15.133:0/1557951469 wait complete. 2024-01-19T04:32:24.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542166 for osd.7 2024-01-19T04:32:24.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea5bfff640 1 -- 172.21.15.133:0/3730517274 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea6401e090 con 0x7fea740716d0 2024-01-19T04:32:24.266 INFO:teuthology.orchestra.run.smithi133.stdout:68719476760 2024-01-19T04:32:24.267 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fea60066580 msgr2=0x7fea60068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fea60066580 0x7fea60068a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea680b2000 tx=0x7fea68008040 comp rx=0 tx=0).stop 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 msgr2=0x7fea741f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 0x7fea741f0490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b550 tx=0x7fea6400ba10 comp rx=0 tx=0).stop 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 shutdown_connections 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fea60066580 0x7fea60068a40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea74071ab0 0x7fea7415b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea740cba20 0x7fea74148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 --2- 172.21.15.133:0/3730517274 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea740716d0 0x7fea741f0490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 >> 172.21.15.133:0/3730517274 conn(0x7fea74066a60 msgr2=0x7fea74151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 shutdown_connections 2024-01-19T04:32:24.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.265+0000 7fea79859640 1 -- 172.21.15.133:0/3730517274 wait complete. 2024-01-19T04:32:24.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476760 got 68719476760 for osd.1 2024-01-19T04:32:24.284 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:24.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.301+0000 7fe22a7fc640 1 -- 172.21.15.133:0/1459955839 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe22c0bc020 con 0x7fe23414fc80 2024-01-19T04:32:24.305 INFO:teuthology.orchestra.run.smithi133.stdout:64424509463 2024-01-19T04:32:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe218066550 msgr2=0x7fe218068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe218066550 0x7fe218068a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe230009730 tx=0x7fe230006ca0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 msgr2=0x7fe234146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 0x7fe234146f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe22c01a5c0 tx=0x7fe22c019730 comp rx=0 tx=0).stop 2024-01-19T04:32:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 shutdown_connections 2024-01-19T04:32:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe218066550 0x7fe218068a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe23414fc80 0x7fe234146f00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2340c5de0 0x7fe23414ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 --2- 172.21.15.133:0/1459955839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2340c46c0 0x7fe2341f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 >> 172.21.15.133:0/1459955839 conn(0x7fe2340cb3e0 msgr2=0x7fe234143270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 shutdown_connections 2024-01-19T04:32:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.305+0000 7fe23c0c0640 1 -- 172.21.15.133:0/1459955839 wait complete. 2024-01-19T04:32:24.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.5 2024-01-19T04:32:24.322 DEBUG:teuthology.parallel:result is None 2024-01-19T04:32:24.323 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-19T04:32:24.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:32:24.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.473+0000 7f38f044a640 1 Processor -- start 2024-01-19T04:32:24.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38f044a640 1 -- start start 2024-01-19T04:32:24.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38f044a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38e80cb260 0x7f38e8070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:24.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38f044a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb640 0x7f38e815a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:24.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38f044a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e8159ea0 con 0x7f38e806f450 2024-01-19T04:32:24.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38f044a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e8159870 con 0x7f38e80cb260 2024-01-19T04:32:24.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38f044a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815d590 con 0x7f38e80cb640 2024-01-19T04:32:24.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38ee1e6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38e80cb260 0x7f38e8070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:24.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38ee1e6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38e80cb260 0x7f38e8070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58658/0 (socket says 172.21.15.133:58658) 2024-01-19T04:32:24.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.477+0000 7f38ee1e6640 1 -- 172.21.15.133:0/2864588946 learned_addr learned my addr 172.21.15.133:0/2864588946 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:24.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.481+0000 7f38ee1e6640 1 -- 172.21.15.133:0/2864588946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb640 msgr2=0x7f38e815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:24.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.481+0000 7f38ee1e6640 1 --2- 172.21.15.133:0/2864588946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb640 0x7f38e815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.481+0000 7f38ee1e6640 1 -- 172.21.15.133:0/2864588946 >> v1:172.21.15.156:6789/0 conn(0x7f38e806f450 legacy=0x7f38e815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:24.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.481+0000 7f38ee1e6640 1 -- 172.21.15.133:0/2864588946 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e815d870 con 0x7f38e80cb260 2024-01-19T04:32:24.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.481+0000 7f38ee1e6640 1 --2- 172.21.15.133:0/2864588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb260 0x7f38e8070f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009870 tx=0x7f38d801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dc0db99aa38fb8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38ed1e4640 1 -- 172.21.15.133:0/2864588946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80a89b0 con 0x7f38e80cb260 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38ed1e4640 1 -- 172.21.15.133:0/2864588946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d80a8b10 con 0x7f38e80cb260 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38ed1e4640 1 -- 172.21.15.133:0/2864588946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80a8ea0 con 0x7f38e80cb260 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- 172.21.15.133:0/2864588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb260 msgr2=0x7f38e8070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 --2- 172.21.15.133:0/2864588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb260 0x7f38e8070f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009870 tx=0x7f38d801ecf0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- 172.21.15.133:0/2864588946 shutdown_connections 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 --2- 172.21.15.133:0/2864588946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb640 0x7f38e815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 --2- 172.21.15.133:0/2864588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb260 0x7f38e8070f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- 172.21.15.133:0/2864588946 >> 172.21.15.133:0/2864588946 conn(0x7f38e806d590 msgr2=0x7f38e8066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:24.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- 172.21.15.133:0/2864588946 shutdown_connections 2024-01-19T04:32:24.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- 172.21.15.133:0/2864588946 wait complete. 2024-01-19T04:32:24.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 Processor -- start 2024-01-19T04:32:24.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- start start 2024-01-19T04:32:24.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e806f450 0x7f38e81580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:24.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb260 0x7f38e81ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:24.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 0x7f38e81efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:24.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e814a660 con 0x7f38e80cb640 2024-01-19T04:32:24.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e81ef480 con 0x7f38e806f450 2024-01-19T04:32:24.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38f044a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e814b0b0 con 0x7f38e80cb260 2024-01-19T04:32:24.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.489+0000 7f38ee9e7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 0x7f38e81efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:24.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 0x7f38e81efe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58660/0 (socket says 172.21.15.133:58660) 2024-01-19T04:32:24.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 -- 172.21.15.133:0/1971829572 learned_addr learned my addr 172.21.15.133:0/1971829572 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 -- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb260 msgr2=0x7f38e81ef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb260 0x7f38e81ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 -- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e806f450 msgr2=0x7f38e81580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e806f450 0x7f38e81580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:24.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.493+0000 7f38ee9e7640 1 -- 172.21.15.133:0/1971829572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80094d0 con 0x7f38e80cb640 2024-01-19T04:32:24.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.497+0000 7f38ee9e7640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 0x7f38e81efe50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38e000c7b0 tx=0x7f38e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.501+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0003d90 con 0x7f38e80cb640 2024-01-19T04:32:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.501+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e0005070 con 0x7f38e80cb640 2024-01-19T04:32:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.501+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0005420 con 0x7f38e80cb640 2024-01-19T04:32:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.501+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e81f2b90 con 0x7f38e80cb640 2024-01-19T04:32:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.501+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e81f3110 con 0x7f38e80cb640 2024-01-19T04:32:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.501+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e8074340 con 0x7f38e80cb640 2024-01-19T04:32:24.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.789+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f38e0005580 con 0x7f38e80cb640 2024-01-19T04:32:24.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.789+0000 7f38deffd640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f38cc066530 0x7f38cc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.789+0000 7f38ee1e6640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f38cc066530 0x7f38cc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.789+0000 7f38ee1e6640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f38cc066530 0x7f38cc0689f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f38d80b2000 tx=0x7f38d8004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:24.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.825+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38e0054af0 con 0x7f38e80cb640 2024-01-19T04:32:24.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.825+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f38e0050730 con 0x7f38e80cb640 2024-01-19T04:32:24.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:24.997+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38e8150e40 con 0x7f38cc066530 2024-01-19T04:32:25.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.049+0000 7f38deffd640 1 -- 172.21.15.133:0/1971829572 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368814 (secure 0 0 0) 0x7f38e8150e40 con 0x7f38cc066530 2024-01-19T04:32:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T04:32:25.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f38cc066530 msgr2=0x7f38cc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f38cc066530 0x7f38cc0689f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f38d80b2000 tx=0x7f38d8004740 comp rx=0 tx=0).stop 2024-01-19T04:32:25.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 msgr2=0x7f38e81efe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 0x7f38e81efe50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38e000c7b0 tx=0x7f38e000cc70 comp rx=0 tx=0).stop 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 shutdown_connections 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f38cc066530 0x7f38cc0689f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38e80cb640 0x7f38e81efe50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e80cb260 0x7f38e81ef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 --2- 172.21.15.133:0/1971829572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e806f450 0x7f38e81580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 >> 172.21.15.133:0/1971829572 conn(0x7f38e806d590 msgr2=0x7f38e8066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:25.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 shutdown_connections 2024-01-19T04:32:25.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.057+0000 7f38f044a640 1 -- 172.21.15.133:0/1971829572 wait complete. 2024-01-19T04:32:25.076 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-19T04:32:23.621380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596559,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":274,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240504,"kb_used_data":3576,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734216,"statfs":{"total":773094113280,"available":772847837184,"internally_reserved":0,"allocated":3661824,"data_stored":2140618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1552,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004705"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.530136+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T04:32:20.530136+0000","last_peered":"2024-01-19T04:32:20.530136+0000","last_clean":"2024-01-19T04:32:20.530136+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T04:32:20.530136+0000","last_undegraded":"2024-01-19T04:32:20.530136+0000","last_fullsized":"2024-01-19T04:32:20.530136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821877+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T04:31:39.821877+0000","last_peered":"2024-01-19T04:31:39.821877+0000","last_clean":"2024-01-19T04:31:39.821877+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T04:31:39.821877+0000","last_undegraded":"2024-01-19T04:31:39.821877+0000","last_fullsized":"2024-01-19T04:31:39.821877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646153+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T04:31:41.646153+0000","last_peered":"2024-01-19T04:31:41.646153+0000","last_clean":"2024-01-19T04:31:41.646153+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T04:31:41.646153+0000","last_undegraded":"2024-01-19T04:31:41.646153+0000","last_fullsized":"2024-01-19T04:31:41.646153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822053+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T04:31:39.822053+0000","last_peered":"2024-01-19T04:31:39.822053+0000","last_clean":"2024-01-19T04:31:39.822053+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T04:31:39.822053+0000","last_undegraded":"2024-01-19T04:31:39.822053+0000","last_fullsized":"2024-01-19T04:31:39.822053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726714+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T04:31:39.726714+0000","last_peered":"2024-01-19T04:31:39.726714+0000","last_clean":"2024-01-19T04:31:39.726714+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T04:31:39.726714+0000","last_undegraded":"2024-01-19T04:31:39.726714+0000","last_fullsized":"2024-01-19T04:31:39.726714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217797+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T04:31:42.217797+0000","last_peered":"2024-01-19T04:31:42.217797+0000","last_clean":"2024-01-19T04:31:42.217797+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T04:31:42.217797+0000","last_undegraded":"2024-01-19T04:31:42.217797+0000","last_fullsized":"2024-01-19T04:31:42.217797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.427220+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T04:32:20.427220+0000","last_peered":"2024-01-19T04:32:20.427220+0000","last_clean":"2024-01-19T04:32:20.427220+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T04:32:20.427220+0000","last_undegraded":"2024-01-19T04:32:20.427220+0000","last_fullsized":"2024-01-19T04:32:20.427220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667121+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T04:31:39.667121+0000","last_peered":"2024-01-19T04:31:39.667121+0000","last_clean":"2024-01-19T04:31:39.667121+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T04:31:39.667121+0000","last_undegraded":"2024-01-19T04:31:39.667121+0000","last_fullsized":"2024-01-19T04:31:39.667121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223120+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T04:31:42.223120+0000","last_peered":"2024-01-19T04:31:42.223120+0000","last_clean":"2024-01-19T04:31:42.223120+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T04:31:42.223120+0000","last_undegraded":"2024-01-19T04:31:42.223120+0000","last_fullsized":"2024-01-19T04:31:42.223120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978611+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T04:31:40.978611+0000","last_peered":"2024-01-19T04:31:40.978611+0000","last_clean":"2024-01-19T04:31:40.978611+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T04:31:40.978611+0000","last_undegraded":"2024-01-19T04:31:40.978611+0000","last_fullsized":"2024-01-19T04:31:40.978611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667803+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T04:31:39.667803+0000","last_peered":"2024-01-19T04:31:39.667803+0000","last_clean":"2024-01-19T04:31:39.667803+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T04:31:39.667803+0000","last_undegraded":"2024-01-19T04:31:39.667803+0000","last_fullsized":"2024-01-19T04:31:39.667803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218929+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T04:31:42.218929+0000","last_peered":"2024-01-19T04:31:42.218929+0000","last_clean":"2024-01-19T04:31:42.218929+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T04:31:42.218929+0000","last_undegraded":"2024-01-19T04:31:42.218929+0000","last_fullsized":"2024-01-19T04:31:42.218929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.010875+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T04:31:41.010875+0000","last_peered":"2024-01-19T04:31:41.010875+0000","last_clean":"2024-01-19T04:31:41.010875+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T04:31:41.010875+0000","last_undegraded":"2024-01-19T04:31:41.010875+0000","last_fullsized":"2024-01-19T04:31:41.010875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934161+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T04:32:12.934161+0000","last_peered":"2024-01-19T04:32:12.934161+0000","last_clean":"2024-01-19T04:32:12.934161+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T04:32:12.934161+0000","last_undegraded":"2024-01-19T04:32:12.934161+0000","last_fullsized":"2024-01-19T04:32:12.934161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222921+0000","last_change":"2024-01-19T04:31:39.820690+0000","last_active":"2024-01-19T04:31:42.222921+0000","last_peered":"2024-01-19T04:31:42.222921+0000","last_clean":"2024-01-19T04:31:42.222921+0000","last_became_active":"2024-01-19T04:31:39.820114+0000","last_became_peered":"2024-01-19T04:31:39.820114+0000","last_unstale":"2024-01-19T04:31:42.222921+0000","last_undegraded":"2024-01-19T04:31:42.222921+0000","last_fullsized":"2024-01-19T04:31:42.222921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817855+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T04:31:39.817855+0000","last_peered":"2024-01-19T04:31:39.817855+0000","last_clean":"2024-01-19T04:31:39.817855+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T04:31:39.817855+0000","last_undegraded":"2024-01-19T04:31:39.817855+0000","last_fullsized":"2024-01-19T04:31:39.817855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286540+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T04:31:41.286540+0000","last_peered":"2024-01-19T04:31:41.286540+0000","last_clean":"2024-01-19T04:31:41.286540+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T04:31:41.286540+0000","last_undegraded":"2024-01-19T04:31:41.286540+0000","last_fullsized":"2024-01-19T04:31:41.286540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.219094+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T04:31:42.219094+0000","last_peered":"2024-01-19T04:31:42.219094+0000","last_clean":"2024-01-19T04:31:42.219094+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T04:31:42.219094+0000","last_undegraded":"2024-01-19T04:31:42.219094+0000","last_fullsized":"2024-01-19T04:31:42.219094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813733+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T04:31:39.813733+0000","last_peered":"2024-01-19T04:31:39.813733+0000","last_clean":"2024-01-19T04:31:39.813733+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T04:31:39.813733+0000","last_undegraded":"2024-01-19T04:31:39.813733+0000","last_fullsized":"2024-01-19T04:31:39.813733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.070096+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T04:32:13.070096+0000","last_peered":"2024-01-19T04:32:13.070096+0000","last_clean":"2024-01-19T04:32:13.070096+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T04:32:13.070096+0000","last_undegraded":"2024-01-19T04:32:13.070096+0000","last_fullsized":"2024-01-19T04:32:13.070096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286153+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T04:31:41.286153+0000","last_peered":"2024-01-19T04:31:41.286153+0000","last_clean":"2024-01-19T04:31:41.286153+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T04:31:41.286153+0000","last_undegraded":"2024-01-19T04:31:41.286153+0000","last_fullsized":"2024-01-19T04:31:41.286153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103858+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T04:31:41.103858+0000","last_peered":"2024-01-19T04:31:41.103858+0000","last_clean":"2024-01-19T04:31:41.103858+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T04:31:41.103858+0000","last_undegraded":"2024-01-19T04:31:41.103858+0000","last_fullsized":"2024-01-19T04:31:41.103858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934190+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T04:32:12.934190+0000","last_peered":"2024-01-19T04:32:12.934190+0000","last_clean":"2024-01-19T04:32:12.934190+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T04:32:12.934190+0000","last_undegraded":"2024-01-19T04:32:12.934190+0000","last_fullsized":"2024-01-19T04:32:12.934190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218706+0000","last_change":"2024-01-19T04:31:39.836900+0000","last_active":"2024-01-19T04:31:42.218706+0000","last_peered":"2024-01-19T04:31:42.218706+0000","last_clean":"2024-01-19T04:31:42.218706+0000","last_became_active":"2024-01-19T04:31:39.834989+0000","last_became_peered":"2024-01-19T04:31:39.834989+0000","last_unstale":"2024-01-19T04:31:42.218706+0000","last_undegraded":"2024-01-19T04:31:42.218706+0000","last_fullsized":"2024-01-19T04:31:42.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:18.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726309+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T04:31:39.726309+0000","last_peered":"2024-01-19T04:31:39.726309+0000","last_clean":"2024-01-19T04:31:39.726309+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T04:31:39.726309+0000","last_undegraded":"2024-01-19T04:31:39.726309+0000","last_fullsized":"2024-01-19T04:31:39.726309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934913+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T04:32:12.934913+0000","last_peered":"2024-01-19T04:32:12.934913+0000","last_clean":"2024-01-19T04:32:12.934913+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T04:32:12.934913+0000","last_undegraded":"2024-01-19T04:32:12.934913+0000","last_fullsized":"2024-01-19T04:32:12.934913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218365+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T04:31:42.218365+0000","last_peered":"2024-01-19T04:31:42.218365+0000","last_clean":"2024-01-19T04:31:42.218365+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T04:31:42.218365+0000","last_undegraded":"2024-01-19T04:31:42.218365+0000","last_fullsized":"2024-01-19T04:31:42.218365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821854+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T04:31:39.821854+0000","last_peered":"2024-01-19T04:31:39.821854+0000","last_clean":"2024-01-19T04:31:39.821854+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T04:31:39.821854+0000","last_undegraded":"2024-01-19T04:31:39.821854+0000","last_fullsized":"2024-01-19T04:31:39.821854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822760+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T04:31:39.822760+0000","last_peered":"2024-01-19T04:31:39.822760+0000","last_clean":"2024-01-19T04:31:39.822760+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T04:31:39.822760+0000","last_undegraded":"2024-01-19T04:31:39.822760+0000","last_fullsized":"2024-01-19T04:31:39.822760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.645798+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T04:31:41.645798+0000","last_peered":"2024-01-19T04:31:41.645798+0000","last_clean":"2024-01-19T04:31:41.645798+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T04:31:41.645798+0000","last_undegraded":"2024-01-19T04:31:41.645798+0000","last_fullsized":"2024-01-19T04:31:41.645798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821924+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T04:31:39.821924+0000","last_peered":"2024-01-19T04:31:39.821924+0000","last_clean":"2024-01-19T04:31:39.821924+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T04:31:39.821924+0000","last_undegraded":"2024-01-19T04:31:39.821924+0000","last_fullsized":"2024-01-19T04:31:39.821924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.254651+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T04:31:41.254651+0000","last_peered":"2024-01-19T04:31:41.254651+0000","last_clean":"2024-01-19T04:31:41.254651+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T04:31:41.254651+0000","last_undegraded":"2024-01-19T04:31:41.254651+0000","last_fullsized":"2024-01-19T04:31:41.254651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.215923+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T04:31:42.215923+0000","last_peered":"2024-01-19T04:31:42.215923+0000","last_clean":"2024-01-19T04:31:42.215923+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T04:31:42.215923+0000","last_undegraded":"2024-01-19T04:31:42.215923+0000","last_fullsized":"2024-01-19T04:31:42.215923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667922+0000","last_change":"2024-01-19T04:31:34.735885+0000","last_active":"2024-01-19T04:31:39.667922+0000","last_peered":"2024-01-19T04:31:39.667922+0000","last_clean":"2024-01-19T04:31:39.667922+0000","last_became_active":"2024-01-19T04:31:34.735325+0000","last_became_peered":"2024-01-19T04:31:34.735325+0000","last_unstale":"2024-01-19T04:31:39.667922+0000","last_undegraded":"2024-01-19T04:31:39.667922+0000","last_fullsized":"2024-01-19T04:31:39.667922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:04.694015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822020+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T04:31:39.822020+0000","last_peered":"2024-01-19T04:31:39.822020+0000","last_clean":"2024-01-19T04:31:39.822020+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T04:31:39.822020+0000","last_undegraded":"2024-01-19T04:31:39.822020+0000","last_fullsized":"2024-01-19T04:31:39.822020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.284616+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T04:31:41.284616+0000","last_peered":"2024-01-19T04:31:41.284616+0000","last_clean":"2024-01-19T04:31:41.284616+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T04:31:41.284616+0000","last_undegraded":"2024-01-19T04:31:41.284616+0000","last_fullsized":"2024-01-19T04:31:41.284616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103444+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T04:31:41.103444+0000","last_peered":"2024-01-19T04:31:41.103444+0000","last_clean":"2024-01-19T04:31:41.103444+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T04:31:41.103444+0000","last_undegraded":"2024-01-19T04:31:41.103444+0000","last_fullsized":"2024-01-19T04:31:41.103444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.221279+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T04:31:42.221279+0000","last_peered":"2024-01-19T04:31:42.221279+0000","last_clean":"2024-01-19T04:31:42.221279+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T04:31:42.221279+0000","last_undegraded":"2024-01-19T04:31:42.221279+0000","last_fullsized":"2024-01-19T04:31:42.221279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286942+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T04:31:41.286942+0000","last_peered":"2024-01-19T04:31:41.286942+0000","last_clean":"2024-01-19T04:31:41.286942+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T04:31:41.286942+0000","last_undegraded":"2024-01-19T04:31:41.286942+0000","last_fullsized":"2024-01-19T04:31:41.286942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820565+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T04:31:39.820565+0000","last_peered":"2024-01-19T04:31:39.820565+0000","last_clean":"2024-01-19T04:31:39.820565+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T04:31:39.820565+0000","last_undegraded":"2024-01-19T04:31:39.820565+0000","last_fullsized":"2024-01-19T04:31:39.820565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.430340+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T04:32:20.430340+0000","last_peered":"2024-01-19T04:32:20.430340+0000","last_clean":"2024-01-19T04:32:20.430340+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T04:32:20.430340+0000","last_undegraded":"2024-01-19T04:32:20.430340+0000","last_fullsized":"2024-01-19T04:32:20.430340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286650+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T04:31:41.286650+0000","last_peered":"2024-01-19T04:31:41.286650+0000","last_clean":"2024-01-19T04:31:41.286650+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T04:31:41.286650+0000","last_undegraded":"2024-01-19T04:31:41.286650+0000","last_fullsized":"2024-01-19T04:31:41.286650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724790+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T04:31:39.724790+0000","last_peered":"2024-01-19T04:31:39.724790+0000","last_clean":"2024-01-19T04:31:39.724790+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T04:31:39.724790+0000","last_undegraded":"2024-01-19T04:31:39.724790+0000","last_fullsized":"2024-01-19T04:31:39.724790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.427801+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T04:32:20.427801+0000","last_peered":"2024-01-19T04:32:20.427801+0000","last_clean":"2024-01-19T04:32:20.427801+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T04:32:20.427801+0000","last_undegraded":"2024-01-19T04:32:20.427801+0000","last_fullsized":"2024-01-19T04:32:20.427801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216628+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T04:31:42.216628+0000","last_peered":"2024-01-19T04:31:42.216628+0000","last_clean":"2024-01-19T04:31:42.216628+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T04:31:42.216628+0000","last_undegraded":"2024-01-19T04:31:42.216628+0000","last_fullsized":"2024-01-19T04:31:42.216628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817644+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T04:31:39.817644+0000","last_peered":"2024-01-19T04:31:39.817644+0000","last_clean":"2024-01-19T04:31:39.817644+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T04:31:39.817644+0000","last_undegraded":"2024-01-19T04:31:39.817644+0000","last_fullsized":"2024-01-19T04:31:39.817644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.946432+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T04:32:12.946432+0000","last_peered":"2024-01-19T04:32:12.946432+0000","last_clean":"2024-01-19T04:32:12.946432+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T04:32:12.946432+0000","last_undegraded":"2024-01-19T04:32:12.946432+0000","last_fullsized":"2024-01-19T04:32:12.946432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979498+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:31:40.979498+0000","last_peered":"2024-01-19T04:31:40.979498+0000","last_clean":"2024-01-19T04:31:40.979498+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:31:40.979498+0000","last_undegraded":"2024-01-19T04:31:40.979498+0000","last_fullsized":"2024-01-19T04:31:40.979498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.221624+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T04:31:42.221624+0000","last_peered":"2024-01-19T04:31:42.221624+0000","last_clean":"2024-01-19T04:31:42.221624+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T04:31:42.221624+0000","last_undegraded":"2024-01-19T04:31:42.221624+0000","last_fullsized":"2024-01-19T04:31:42.221624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978524+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T04:31:40.978524+0000","last_peered":"2024-01-19T04:31:40.978524+0000","last_clean":"2024-01-19T04:31:40.978524+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T04:31:40.978524+0000","last_undegraded":"2024-01-19T04:31:40.978524+0000","last_fullsized":"2024-01-19T04:31:40.978524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.424245+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T04:32:20.424245+0000","last_peered":"2024-01-19T04:32:20.424245+0000","last_clean":"2024-01-19T04:32:20.424245+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T04:32:20.424245+0000","last_undegraded":"2024-01-19T04:32:20.424245+0000","last_fullsized":"2024-01-19T04:32:20.424245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216922+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T04:31:42.216922+0000","last_peered":"2024-01-19T04:31:42.216922+0000","last_clean":"2024-01-19T04:31:42.216922+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T04:31:42.216922+0000","last_undegraded":"2024-01-19T04:31:42.216922+0000","last_fullsized":"2024-01-19T04:31:42.216922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667067+0000","last_change":"2024-01-19T04:31:34.736261+0000","last_active":"2024-01-19T04:31:39.667067+0000","last_peered":"2024-01-19T04:31:39.667067+0000","last_clean":"2024-01-19T04:31:39.667067+0000","last_became_active":"2024-01-19T04:31:34.735525+0000","last_became_peered":"2024-01-19T04:31:34.735525+0000","last_unstale":"2024-01-19T04:31:39.667067+0000","last_undegraded":"2024-01-19T04:31:39.667067+0000","last_fullsized":"2024-01-19T04:31:39.667067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:41.517467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822263+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T04:31:39.822263+0000","last_peered":"2024-01-19T04:31:39.822263+0000","last_clean":"2024-01-19T04:31:39.822263+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T04:31:39.822263+0000","last_undegraded":"2024-01-19T04:31:39.822263+0000","last_fullsized":"2024-01-19T04:31:39.822263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216080+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T04:31:42.216080+0000","last_peered":"2024-01-19T04:31:42.216080+0000","last_clean":"2024-01-19T04:31:42.216080+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T04:31:42.216080+0000","last_undegraded":"2024-01-19T04:31:42.216080+0000","last_fullsized":"2024-01-19T04:31:42.216080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979841+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T04:31:40.979841+0000","last_peered":"2024-01-19T04:31:40.979841+0000","last_clean":"2024-01-19T04:31:40.979841+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T04:31:40.979841+0000","last_undegraded":"2024-01-19T04:31:40.979841+0000","last_fullsized":"2024-01-19T04:31:40.979841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813374+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T04:31:39.813374+0000","last_peered":"2024-01-19T04:31:39.813374+0000","last_clean":"2024-01-19T04:31:39.813374+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T04:31:39.813374+0000","last_undegraded":"2024-01-19T04:31:39.813374+0000","last_fullsized":"2024-01-19T04:31:39.813374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217615+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T04:31:42.217615+0000","last_peered":"2024-01-19T04:31:42.217615+0000","last_clean":"2024-01-19T04:31:42.217615+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T04:31:42.217615+0000","last_undegraded":"2024-01-19T04:31:42.217615+0000","last_fullsized":"2024-01-19T04:31:42.217615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979462+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T04:31:40.979462+0000","last_peered":"2024-01-19T04:31:40.979462+0000","last_clean":"2024-01-19T04:31:40.979462+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T04:31:40.979462+0000","last_undegraded":"2024-01-19T04:31:40.979462+0000","last_fullsized":"2024-01-19T04:31:40.979462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104895+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T04:31:41.104895+0000","last_peered":"2024-01-19T04:31:41.104895+0000","last_clean":"2024-01-19T04:31:41.104895+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T04:31:41.104895+0000","last_undegraded":"2024-01-19T04:31:41.104895+0000","last_fullsized":"2024-01-19T04:31:41.104895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217971+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T04:31:42.217971+0000","last_peered":"2024-01-19T04:31:42.217971+0000","last_clean":"2024-01-19T04:31:42.217971+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T04:31:42.217971+0000","last_undegraded":"2024-01-19T04:31:42.217971+0000","last_fullsized":"2024-01-19T04:31:42.217971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978224+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T04:31:40.978224+0000","last_peered":"2024-01-19T04:31:40.978224+0000","last_clean":"2024-01-19T04:31:40.978224+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T04:31:40.978224+0000","last_undegraded":"2024-01-19T04:31:40.978224+0000","last_fullsized":"2024-01-19T04:31:40.978224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.429552+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T04:32:20.429552+0000","last_peered":"2024-01-19T04:32:20.429552+0000","last_clean":"2024-01-19T04:32:20.429552+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T04:32:20.429552+0000","last_undegraded":"2024-01-19T04:32:20.429552+0000","last_fullsized":"2024-01-19T04:32:20.429552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216542+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T04:31:42.216542+0000","last_peered":"2024-01-19T04:31:42.216542+0000","last_clean":"2024-01-19T04:31:42.216542+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T04:31:42.216542+0000","last_undegraded":"2024-01-19T04:31:42.216542+0000","last_fullsized":"2024-01-19T04:31:42.216542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008763+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T04:31:41.008763+0000","last_peered":"2024-01-19T04:31:41.008763+0000","last_clean":"2024-01-19T04:31:41.008763+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T04:31:41.008763+0000","last_undegraded":"2024-01-19T04:31:41.008763+0000","last_fullsized":"2024-01-19T04:31:41.008763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008759+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T04:31:41.008759+0000","last_peered":"2024-01-19T04:31:41.008759+0000","last_clean":"2024-01-19T04:31:41.008759+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T04:31:41.008759+0000","last_undegraded":"2024-01-19T04:31:41.008759+0000","last_fullsized":"2024-01-19T04:31:41.008759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.648374+0000","last_change":"2024-01-19T04:31:39.841628+0000","last_active":"2024-01-19T04:31:41.648374+0000","last_peered":"2024-01-19T04:31:41.648374+0000","last_clean":"2024-01-19T04:31:41.648374+0000","last_became_active":"2024-01-19T04:31:39.841239+0000","last_became_peered":"2024-01-19T04:31:39.841239+0000","last_unstale":"2024-01-19T04:31:41.648374+0000","last_undegraded":"2024-01-19T04:31:41.648374+0000","last_fullsized":"2024-01-19T04:31:41.648374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:26:24.623871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978985+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T04:31:40.978985+0000","last_peered":"2024-01-19T04:31:40.978985+0000","last_clean":"2024-01-19T04:31:40.978985+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T04:31:40.978985+0000","last_undegraded":"2024-01-19T04:31:40.978985+0000","last_fullsized":"2024-01-19T04:31:40.978985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.943944+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T04:32:12.943944+0000","last_peered":"2024-01-19T04:32:12.943944+0000","last_clean":"2024-01-19T04:32:12.943944+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T04:32:12.943944+0000","last_undegraded":"2024-01-19T04:32:12.943944+0000","last_fullsized":"2024-01-19T04:32:12.943944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647710+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T04:31:41.647710+0000","last_peered":"2024-01-19T04:31:41.647710+0000","last_clean":"2024-01-19T04:31:41.647710+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T04:31:41.647710+0000","last_undegraded":"2024-01-19T04:31:41.647710+0000","last_fullsized":"2024-01-19T04:31:41.647710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724950+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T04:31:39.724950+0000","last_peered":"2024-01-19T04:31:39.724950+0000","last_clean":"2024-01-19T04:31:39.724950+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T04:31:39.724950+0000","last_undegraded":"2024-01-19T04:31:39.724950+0000","last_fullsized":"2024-01-19T04:31:39.724950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.490062+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T04:32:20.490062+0000","last_peered":"2024-01-19T04:32:20.490062+0000","last_clean":"2024-01-19T04:32:20.490062+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T04:32:20.490062+0000","last_undegraded":"2024-01-19T04:32:20.490062+0000","last_fullsized":"2024-01-19T04:32:20.490062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222496+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T04:31:42.222496+0000","last_peered":"2024-01-19T04:31:42.222496+0000","last_clean":"2024-01-19T04:31:42.222496+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T04:31:42.222496+0000","last_undegraded":"2024-01-19T04:31:42.222496+0000","last_fullsized":"2024-01-19T04:31:42.222496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978551+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T04:31:40.978551+0000","last_peered":"2024-01-19T04:31:40.978551+0000","last_clean":"2024-01-19T04:31:40.978551+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T04:31:40.978551+0000","last_undegraded":"2024-01-19T04:31:40.978551+0000","last_fullsized":"2024-01-19T04:31:40.978551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.933754+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T04:32:12.933754+0000","last_peered":"2024-01-19T04:32:12.933754+0000","last_clean":"2024-01-19T04:32:12.933754+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T04:32:12.933754+0000","last_undegraded":"2024-01-19T04:32:12.933754+0000","last_fullsized":"2024-01-19T04:32:12.933754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285152+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T04:31:41.285152+0000","last_peered":"2024-01-19T04:31:41.285152+0000","last_clean":"2024-01-19T04:31:41.285152+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T04:31:41.285152+0000","last_undegraded":"2024-01-19T04:31:41.285152+0000","last_fullsized":"2024-01-19T04:31:41.285152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104147+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T04:31:41.104147+0000","last_peered":"2024-01-19T04:31:41.104147+0000","last_clean":"2024-01-19T04:31:41.104147+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T04:31:41.104147+0000","last_undegraded":"2024-01-19T04:31:41.104147+0000","last_fullsized":"2024-01-19T04:31:41.104147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285986+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T04:31:41.285986+0000","last_peered":"2024-01-19T04:31:41.285986+0000","last_clean":"2024-01-19T04:31:41.285986+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T04:31:41.285986+0000","last_undegraded":"2024-01-19T04:31:41.285986+0000","last_fullsized":"2024-01-19T04:31:41.285986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223324+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T04:31:42.223324+0000","last_peered":"2024-01-19T04:31:42.223324+0000","last_clean":"2024-01-19T04:31:42.223324+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T04:31:42.223324+0000","last_undegraded":"2024-01-19T04:31:42.223324+0000","last_fullsized":"2024-01-19T04:31:42.223324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726771+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T04:31:39.726771+0000","last_peered":"2024-01-19T04:31:39.726771+0000","last_clean":"2024-01-19T04:31:39.726771+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T04:31:39.726771+0000","last_undegraded":"2024-01-19T04:31:39.726771+0000","last_fullsized":"2024-01-19T04:31:39.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.941821+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T04:32:12.941821+0000","last_peered":"2024-01-19T04:32:12.941821+0000","last_clean":"2024-01-19T04:32:12.941821+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T04:32:12.941821+0000","last_undegraded":"2024-01-19T04:32:12.941821+0000","last_fullsized":"2024-01-19T04:32:12.941821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646384+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T04:31:41.646384+0000","last_peered":"2024-01-19T04:31:41.646384+0000","last_clean":"2024-01-19T04:31:41.646384+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T04:31:41.646384+0000","last_undegraded":"2024-01-19T04:31:41.646384+0000","last_fullsized":"2024-01-19T04:31:41.646384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668228+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T04:31:39.668228+0000","last_peered":"2024-01-19T04:31:39.668228+0000","last_clean":"2024-01-19T04:31:39.668228+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T04:31:39.668228+0000","last_undegraded":"2024-01-19T04:31:39.668228+0000","last_fullsized":"2024-01-19T04:31:39.668228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934809+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T04:32:12.934809+0000","last_peered":"2024-01-19T04:32:12.934809+0000","last_clean":"2024-01-19T04:32:12.934809+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T04:32:12.934809+0000","last_undegraded":"2024-01-19T04:32:12.934809+0000","last_fullsized":"2024-01-19T04:32:12.934809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646461+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T04:31:41.646461+0000","last_peered":"2024-01-19T04:31:41.646461+0000","last_clean":"2024-01-19T04:31:41.646461+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T04:31:41.646461+0000","last_undegraded":"2024-01-19T04:31:41.646461+0000","last_fullsized":"2024-01-19T04:31:41.646461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216448+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T04:31:42.216448+0000","last_peered":"2024-01-19T04:31:42.216448+0000","last_clean":"2024-01-19T04:31:42.216448+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T04:31:42.216448+0000","last_undegraded":"2024-01-19T04:31:42.216448+0000","last_fullsized":"2024-01-19T04:31:42.216448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820389+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T04:31:39.820389+0000","last_peered":"2024-01-19T04:31:39.820389+0000","last_clean":"2024-01-19T04:31:39.820389+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T04:31:39.820389+0000","last_undegraded":"2024-01-19T04:31:39.820389+0000","last_fullsized":"2024-01-19T04:31:39.820389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218875+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T04:31:42.218875+0000","last_peered":"2024-01-19T04:31:42.218875+0000","last_clean":"2024-01-19T04:31:42.218875+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T04:31:42.218875+0000","last_undegraded":"2024-01-19T04:31:42.218875+0000","last_fullsized":"2024-01-19T04:31:42.218875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222235+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T04:31:42.222235+0000","last_peered":"2024-01-19T04:31:42.222235+0000","last_clean":"2024-01-19T04:31:42.222235+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T04:31:42.222235+0000","last_undegraded":"2024-01-19T04:31:42.222235+0000","last_fullsized":"2024-01-19T04:31:42.222235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813740+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T04:31:39.813740+0000","last_peered":"2024-01-19T04:31:39.813740+0000","last_clean":"2024-01-19T04:31:39.813740+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T04:31:39.813740+0000","last_undegraded":"2024-01-19T04:31:39.813740+0000","last_fullsized":"2024-01-19T04:31:39.813740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817749+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T04:31:39.817749+0000","last_peered":"2024-01-19T04:31:39.817749+0000","last_clean":"2024-01-19T04:31:39.817749+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T04:31:39.817749+0000","last_undegraded":"2024-01-19T04:31:39.817749+0000","last_fullsized":"2024-01-19T04:31:39.817749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.011146+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T04:31:41.011146+0000","last_peered":"2024-01-19T04:31:41.011146+0000","last_clean":"2024-01-19T04:31:41.011146+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T04:31:41.011146+0000","last_undegraded":"2024-01-19T04:31:41.011146+0000","last_fullsized":"2024-01-19T04:31:41.011146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725708+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T04:31:39.725708+0000","last_peered":"2024-01-19T04:31:39.725708+0000","last_clean":"2024-01-19T04:31:39.725708+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T04:31:39.725708+0000","last_undegraded":"2024-01-19T04:31:39.725708+0000","last_fullsized":"2024-01-19T04:31:39.725708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275109+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T04:31:41.275109+0000","last_peered":"2024-01-19T04:31:41.275109+0000","last_clean":"2024-01-19T04:31:41.275109+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T04:31:41.275109+0000","last_undegraded":"2024-01-19T04:31:41.275109+0000","last_fullsized":"2024-01-19T04:31:41.275109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.064237+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T04:32:13.064237+0000","last_peered":"2024-01-19T04:32:13.064237+0000","last_clean":"2024-01-19T04:32:13.064237+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T04:32:13.064237+0000","last_undegraded":"2024-01-19T04:32:13.064237+0000","last_fullsized":"2024-01-19T04:32:13.064237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103673+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T04:31:41.103673+0000","last_peered":"2024-01-19T04:31:41.103673+0000","last_clean":"2024-01-19T04:31:41.103673+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T04:31:41.103673+0000","last_undegraded":"2024-01-19T04:31:41.103673+0000","last_fullsized":"2024-01-19T04:31:41.103673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647676+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T04:31:41.647676+0000","last_peered":"2024-01-19T04:31:41.647676+0000","last_clean":"2024-01-19T04:31:41.647676+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T04:31:41.647676+0000","last_undegraded":"2024-01-19T04:31:41.647676+0000","last_fullsized":"2024-01-19T04:31:41.647676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008510+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T04:31:41.008510+0000","last_peered":"2024-01-19T04:31:41.008510+0000","last_clean":"2024-01-19T04:31:41.008510+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T04:31:41.008510+0000","last_undegraded":"2024-01-19T04:31:41.008510+0000","last_fullsized":"2024-01-19T04:31:41.008510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.812464+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T04:31:39.812464+0000","last_peered":"2024-01-19T04:31:39.812464+0000","last_clean":"2024-01-19T04:31:39.812464+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T04:31:39.812464+0000","last_undegraded":"2024-01-19T04:31:39.812464+0000","last_fullsized":"2024-01-19T04:31:39.812464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666159+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T04:31:39.666159+0000","last_peered":"2024-01-19T04:31:39.666159+0000","last_clean":"2024-01-19T04:31:39.666159+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T04:31:39.666159+0000","last_undegraded":"2024-01-19T04:31:39.666159+0000","last_fullsized":"2024-01-19T04:31:39.666159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725587+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T04:31:39.725587+0000","last_peered":"2024-01-19T04:31:39.725587+0000","last_clean":"2024-01-19T04:31:39.725587+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T04:31:39.725587+0000","last_undegraded":"2024-01-19T04:31:39.725587+0000","last_fullsized":"2024-01-19T04:31:39.725587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821683+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T04:31:39.821683+0000","last_peered":"2024-01-19T04:31:39.821683+0000","last_clean":"2024-01-19T04:31:39.821683+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T04:31:39.821683+0000","last_undegraded":"2024-01-19T04:31:39.821683+0000","last_fullsized":"2024-01-19T04:31:39.821683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822108+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T04:31:39.822108+0000","last_peered":"2024-01-19T04:31:39.822108+0000","last_clean":"2024-01-19T04:31:39.822108+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T04:31:39.822108+0000","last_undegraded":"2024-01-19T04:31:39.822108+0000","last_fullsized":"2024-01-19T04:31:39.822108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009546+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T04:31:41.009546+0000","last_peered":"2024-01-19T04:31:41.009546+0000","last_clean":"2024-01-19T04:31:41.009546+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T04:31:41.009546+0000","last_undegraded":"2024-01-19T04:31:41.009546+0000","last_fullsized":"2024-01-19T04:31:41.009546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821774+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T04:31:39.821774+0000","last_peered":"2024-01-19T04:31:39.821774+0000","last_clean":"2024-01-19T04:31:39.821774+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T04:31:39.821774+0000","last_undegraded":"2024-01-19T04:31:39.821774+0000","last_fullsized":"2024-01-19T04:31:39.821774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666053+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T04:31:39.666053+0000","last_peered":"2024-01-19T04:31:39.666053+0000","last_clean":"2024-01-19T04:31:39.666053+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T04:31:39.666053+0000","last_undegraded":"2024-01-19T04:31:39.666053+0000","last_fullsized":"2024-01-19T04:31:39.666053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817657+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T04:31:39.817657+0000","last_peered":"2024-01-19T04:31:39.817657+0000","last_clean":"2024-01-19T04:31:39.817657+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T04:31:39.817657+0000","last_undegraded":"2024-01-19T04:31:39.817657+0000","last_fullsized":"2024-01-19T04:31:39.817657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665952+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T04:31:39.665952+0000","last_peered":"2024-01-19T04:31:39.665952+0000","last_clean":"2024-01-19T04:31:39.665952+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T04:31:39.665952+0000","last_undegraded":"2024-01-19T04:31:39.665952+0000","last_fullsized":"2024-01-19T04:31:39.665952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725169+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T04:31:39.725169+0000","last_peered":"2024-01-19T04:31:39.725169+0000","last_clean":"2024-01-19T04:31:39.725169+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T04:31:39.725169+0000","last_undegraded":"2024-01-19T04:31:39.725169+0000","last_fullsized":"2024-01-19T04:31:39.725169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008993+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T04:31:41.008993+0000","last_peered":"2024-01-19T04:31:41.008993+0000","last_clean":"2024-01-19T04:31:41.008993+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T04:31:41.008993+0000","last_undegraded":"2024-01-19T04:31:41.008993+0000","last_fullsized":"2024-01-19T04:31:41.008993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979162+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T04:31:40.979162+0000","last_peered":"2024-01-19T04:31:40.979162+0000","last_clean":"2024-01-19T04:31:40.979162+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T04:31:40.979162+0000","last_undegraded":"2024-01-19T04:31:40.979162+0000","last_fullsized":"2024-01-19T04:31:40.979162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813279+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T04:31:39.813279+0000","last_peered":"2024-01-19T04:31:39.813279+0000","last_clean":"2024-01-19T04:31:39.813279+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T04:31:39.813279+0000","last_undegraded":"2024-01-19T04:31:39.813279+0000","last_fullsized":"2024-01-19T04:31:39.813279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668465+0000","last_change":"2024-01-19T04:31:34.743868+0000","last_active":"2024-01-19T04:31:39.668465+0000","last_peered":"2024-01-19T04:31:39.668465+0000","last_clean":"2024-01-19T04:31:39.668465+0000","last_became_active":"2024-01-19T04:31:34.743503+0000","last_became_peered":"2024-01-19T04:31:34.743503+0000","last_unstale":"2024-01-19T04:31:39.668465+0000","last_undegraded":"2024-01-19T04:31:39.668465+0000","last_fullsized":"2024-01-19T04:31:39.668465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:22.598439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665835+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T04:31:39.665835+0000","last_peered":"2024-01-19T04:31:39.665835+0000","last_clean":"2024-01-19T04:31:39.665835+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T04:31:39.665835+0000","last_undegraded":"2024-01-19T04:31:39.665835+0000","last_fullsized":"2024-01-19T04:31:39.665835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820435+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T04:31:39.820435+0000","last_peered":"2024-01-19T04:31:39.820435+0000","last_clean":"2024-01-19T04:31:39.820435+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T04:31:39.820435+0000","last_undegraded":"2024-01-19T04:31:39.820435+0000","last_fullsized":"2024-01-19T04:31:39.820435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724966+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T04:31:39.724966+0000","last_peered":"2024-01-19T04:31:39.724966+0000","last_clean":"2024-01-19T04:31:39.724966+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T04:31:39.724966+0000","last_undegraded":"2024-01-19T04:31:39.724966+0000","last_fullsized":"2024-01-19T04:31:39.724966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817772+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T04:31:39.817772+0000","last_peered":"2024-01-19T04:31:39.817772+0000","last_clean":"2024-01-19T04:31:39.817772+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T04:31:39.817772+0000","last_undegraded":"2024-01-19T04:31:39.817772+0000","last_fullsized":"2024-01-19T04:31:39.817772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104062+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T04:31:41.104062+0000","last_peered":"2024-01-19T04:31:41.104062+0000","last_clean":"2024-01-19T04:31:41.104062+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T04:31:41.104062+0000","last_undegraded":"2024-01-19T04:31:41.104062+0000","last_fullsized":"2024-01-19T04:31:41.104062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009588+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T04:31:41.009588+0000","last_peered":"2024-01-19T04:31:41.009588+0000","last_clean":"2024-01-19T04:31:41.009588+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T04:31:41.009588+0000","last_undegraded":"2024-01-19T04:31:41.009588+0000","last_fullsized":"2024-01-19T04:31:41.009588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009336+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T04:31:41.009336+0000","last_peered":"2024-01-19T04:31:41.009336+0000","last_clean":"2024-01-19T04:31:41.009336+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T04:31:41.009336+0000","last_undegraded":"2024-01-19T04:31:41.009336+0000","last_fullsized":"2024-01-19T04:31:41.009336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979732+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T04:31:40.979732+0000","last_peered":"2024-01-19T04:31:40.979732+0000","last_clean":"2024-01-19T04:31:40.979732+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T04:31:40.979732+0000","last_undegraded":"2024-01-19T04:31:40.979732+0000","last_fullsized":"2024-01-19T04:31:40.979732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.809480+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T04:31:39.809480+0000","last_peered":"2024-01-19T04:31:39.809480+0000","last_clean":"2024-01-19T04:31:39.809480+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T04:31:39.809480+0000","last_undegraded":"2024-01-19T04:31:39.809480+0000","last_fullsized":"2024-01-19T04:31:39.809480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978084+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T04:31:40.978084+0000","last_peered":"2024-01-19T04:31:40.978084+0000","last_clean":"2024-01-19T04:31:40.978084+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T04:31:40.978084+0000","last_undegraded":"2024-01-19T04:31:40.978084+0000","last_fullsized":"2024-01-19T04:31:40.978084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665994+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T04:31:39.665994+0000","last_peered":"2024-01-19T04:31:39.665994+0000","last_clean":"2024-01-19T04:31:39.665994+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T04:31:39.665994+0000","last_undegraded":"2024-01-19T04:31:39.665994+0000","last_fullsized":"2024-01-19T04:31:39.665994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978264+0000","last_change":"2024-01-19T04:31:33.071431+0000","last_active":"2024-01-19T04:31:40.978264+0000","last_peered":"2024-01-19T04:31:40.978264+0000","last_clean":"2024-01-19T04:31:40.978264+0000","last_became_active":"2024-01-19T04:31:33.070826+0000","last_became_peered":"2024-01-19T04:31:33.070826+0000","last_unstale":"2024-01-19T04:31:40.978264+0000","last_undegraded":"2024-01-19T04:31:40.978264+0000","last_fullsized":"2024-01-19T04:31:40.978264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:36:31.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666838+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T04:31:39.666838+0000","last_peered":"2024-01-19T04:31:39.666838+0000","last_clean":"2024-01-19T04:31:39.666838+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T04:31:39.666838+0000","last_undegraded":"2024-01-19T04:31:39.666838+0000","last_fullsized":"2024-01-19T04:31:39.666838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724952+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T04:31:39.724952+0000","last_peered":"2024-01-19T04:31:39.724952+0000","last_clean":"2024-01-19T04:31:39.724952+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T04:31:39.724952+0000","last_undegraded":"2024-01-19T04:31:39.724952+0000","last_fullsized":"2024-01-19T04:31:39.724952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822589+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T04:31:39.822589+0000","last_peered":"2024-01-19T04:31:39.822589+0000","last_clean":"2024-01-19T04:31:39.822589+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T04:31:39.822589+0000","last_undegraded":"2024-01-19T04:31:39.822589+0000","last_fullsized":"2024-01-19T04:31:39.822589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979575+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T04:31:40.979575+0000","last_peered":"2024-01-19T04:31:40.979575+0000","last_clean":"2024-01-19T04:31:40.979575+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T04:31:40.979575+0000","last_undegraded":"2024-01-19T04:31:40.979575+0000","last_fullsized":"2024-01-19T04:31:40.979575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6191,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":12270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476759,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.504}]},{"osd":3,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.77300000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.008}]},{"osd":5,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.90100000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.034},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.2170000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.1080000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476760,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":119306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.86599999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":122405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.7309999999999999,"5min":5.7309999999999999,"15min":5.7309999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7850000000000001,"5min":5.7850000000000001,"15min":5.7850000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0140000000000002,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.5229999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.605}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":5.6920000000000002,"5min":5.6920000000000002,"15min":5.6920000000000002},"last":1.0509999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":119236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.95899999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.0449999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0269999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":118600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.97599999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92100000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.081},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.107},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.1499999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1759999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":122937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.83799999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":909312,"data_stored":710158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.88400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.1020000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.044},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75800000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.01}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.073},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1639999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":709502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.623}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.93999999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.111}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.04}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:32:25.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:32:25.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.237+0000 7fb020141640 1 Processor -- start 2024-01-19T04:32:25.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.237+0000 7fb020141640 1 -- start start 2024-01-19T04:32:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb020141640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb018153960 0x7fb0180c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb020141640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb018159740 con 0x7fb0180c3de0 2024-01-19T04:32:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb020141640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb018153d40 con 0x7fb01815d610 2024-01-19T04:32:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb020141640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0181599e0 con 0x7fb018153960 2024-01-19T04:32:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb01dedd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb018153960 0x7fb0180c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb01d6dc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb0180c3de0 0x7fb01815cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60974/0 (socket says 172.21.15.133:60974) 2024-01-19T04:32:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.241+0000 7fb01d6dc640 1 -- 172.21.15.133:0/2440097818 learned_addr learned my addr 172.21.15.133:0/2440097818 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.245+0000 7fb01dedd640 1 -- 172.21.15.133:0/2440097818 >> v1:172.21.15.156:6789/0 conn(0x7fb01815d610 legacy=0x7fb0180cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.245+0000 7fb01dedd640 1 -- 172.21.15.133:0/2440097818 >> v1:172.21.15.133:6789/0 conn(0x7fb0180c3de0 legacy=0x7fb01815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.245+0000 7fb01dedd640 1 -- 172.21.15.133:0/2440097818 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018159cc0 con 0x7fb018153960 2024-01-19T04:32:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.249+0000 7fb01dedd640 1 --2- 172.21.15.133:0/2440097818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb018153960 0x7fb0180c9da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097c0 tx=0x7fb00c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fcabaec4e9891 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb01cedb640 1 -- 172.21.15.133:0/2440097818 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0a8930 con 0x7fb018153960 2024-01-19T04:32:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb01cedb640 1 -- 172.21.15.133:0/2440097818 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c0a8a90 con 0x7fb018153960 2024-01-19T04:32:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb01cedb640 1 -- 172.21.15.133:0/2440097818 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0a8e20 con 0x7fb018153960 2024-01-19T04:32:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 -- 172.21.15.133:0/2440097818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb018153960 msgr2=0x7fb0180c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 --2- 172.21.15.133:0/2440097818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb018153960 0x7fb0180c9da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097c0 tx=0x7fb00c01ec30 comp rx=0 tx=0).stop 2024-01-19T04:32:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 -- 172.21.15.133:0/2440097818 shutdown_connections 2024-01-19T04:32:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 --2- 172.21.15.133:0/2440097818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb018153960 0x7fb0180c9da0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 -- 172.21.15.133:0/2440097818 >> 172.21.15.133:0/2440097818 conn(0x7fb01808afa0 msgr2=0x7fb01808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 -- 172.21.15.133:0/2440097818 shutdown_connections 2024-01-19T04:32:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.253+0000 7fb020141640 1 -- 172.21.15.133:0/2440097818 wait complete. 2024-01-19T04:32:25.257 INFO:tasks.ceph.mds.e.smithi133.stderr:2024-01-19T04:32:25.257+0000 f9d6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-01-19T04:32:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 Processor -- start 2024-01-19T04:32:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 -- start start 2024-01-19T04:32:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0180c3de0 0x7fb01814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb018153960 0x7fb0180c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 0x7fb0181f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181e55e0 con 0x7fb01815d610 2024-01-19T04:32:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01815c510 con 0x7fb0180c3de0 2024-01-19T04:32:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb020141640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181e5300 con 0x7fb018153960 2024-01-19T04:32:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb01e6de640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 0x7fb0181f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb01e6de640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 0x7fb0181f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58676/0 (socket says 172.21.15.133:58676) 2024-01-19T04:32:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.257+0000 7fb01e6de640 1 -- 172.21.15.133:0/2823336833 learned_addr learned my addr 172.21.15.133:0/2823336833 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.261+0000 7fb01dedd640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0180c3de0 0x7fb01814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.261+0000 7fb01e6de640 1 -- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb018153960 msgr2=0x7fb0180c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.261+0000 7fb01e6de640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb018153960 0x7fb0180c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.261+0000 7fb01e6de640 1 -- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0180c3de0 msgr2=0x7fb01814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.261+0000 7fb01e6de640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0180c3de0 0x7fb01814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.261+0000 7fb01e6de640 1 -- 172.21.15.133:0/2823336833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c009420 con 0x7fb01815d610 2024-01-19T04:32:25.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.269+0000 7fb01e6de640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 0x7fb0181f2fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b990 tx=0x7fb01000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.277+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01000cba0 con 0x7fb01815d610 2024-01-19T04:32:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.277+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01000cd00 con 0x7fb01815d610 2024-01-19T04:32:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.277+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010014680 con 0x7fb01815d610 2024-01-19T04:32:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.277+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018151210 con 0x7fb01815d610 2024-01-19T04:32:25.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.277+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0181f2ac0 con 0x7fb01815d610 2024-01-19T04:32:25.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.277+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0181f2ce0 con 0x7fb01815d610 2024-01-19T04:32:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.301+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb01001d3b0 con 0x7fb01815d610 2024-01-19T04:32:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.301+0000 7fb00a7fc640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faffc066550 0x7faffc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.301+0000 7fb01dedd640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faffc066550 0x7faffc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.301+0000 7fb01dedd640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faffc066550 0x7faffc068a10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0b2000 tx=0x7fb00c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.305+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0100558f0 con 0x7fb01815d610 2024-01-19T04:32:25.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.609+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb010051530 con 0x7fb01815d610 2024-01-19T04:32:25.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.793+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb01815a560 con 0x7faffc066550 2024-01-19T04:32:25.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.841+0000 7fb00a7fc640 1 -- 172.21.15.133:0/2823336833 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368667 (secure 0 0 0) 0x7fb00c0c0090 con 0x7faffc066550 2024-01-19T04:32:25.847 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:25.849 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T04:32:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faffc066550 msgr2=0x7faffc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faffc066550 0x7faffc068a10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0b2000 tx=0x7fb00c0aa070 comp rx=0 tx=0).stop 2024-01-19T04:32:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 msgr2=0x7fb0181f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 0x7fb0181f2fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b990 tx=0x7fb01000be50 comp rx=0 tx=0).stop 2024-01-19T04:32:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 shutdown_connections 2024-01-19T04:32:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7faffc066550 0x7faffc068a10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01815d610 0x7fb0181f2fe0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb018153960 0x7fb0180c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 --2- 172.21.15.133:0/2823336833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0180c3de0 0x7fb01814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:25.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 >> 172.21.15.133:0/2823336833 conn(0x7fb01808afa0 msgr2=0x7fb0180ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 shutdown_connections 2024-01-19T04:32:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:25.845+0000 7fb020141640 1 -- 172.21.15.133:0/2823336833 wait complete. 2024-01-19T04:32:25.866 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-19T04:32:25.621961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598407,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":299,"num_write_kb":2466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240556,"kb_used_data":3628,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734164,"statfs":{"total":773094113280,"available":772847783936,"internally_reserved":0,"allocated":3715072,"data_stored":2144018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3400,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004502"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.530136+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T04:32:20.530136+0000","last_peered":"2024-01-19T04:32:20.530136+0000","last_clean":"2024-01-19T04:32:20.530136+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T04:32:20.530136+0000","last_undegraded":"2024-01-19T04:32:20.530136+0000","last_fullsized":"2024-01-19T04:32:20.530136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821877+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T04:31:39.821877+0000","last_peered":"2024-01-19T04:31:39.821877+0000","last_clean":"2024-01-19T04:31:39.821877+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T04:31:39.821877+0000","last_undegraded":"2024-01-19T04:31:39.821877+0000","last_fullsized":"2024-01-19T04:31:39.821877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646153+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T04:31:41.646153+0000","last_peered":"2024-01-19T04:31:41.646153+0000","last_clean":"2024-01-19T04:31:41.646153+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T04:31:41.646153+0000","last_undegraded":"2024-01-19T04:31:41.646153+0000","last_fullsized":"2024-01-19T04:31:41.646153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.648048+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T04:31:41.648048+0000","last_peered":"2024-01-19T04:31:41.648048+0000","last_clean":"2024-01-19T04:31:41.648048+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T04:31:41.648048+0000","last_undegraded":"2024-01-19T04:31:41.648048+0000","last_fullsized":"2024-01-19T04:31:41.648048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726714+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T04:31:39.726714+0000","last_peered":"2024-01-19T04:31:39.726714+0000","last_clean":"2024-01-19T04:31:39.726714+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T04:31:39.726714+0000","last_undegraded":"2024-01-19T04:31:39.726714+0000","last_fullsized":"2024-01-19T04:31:39.726714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217797+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T04:31:42.217797+0000","last_peered":"2024-01-19T04:31:42.217797+0000","last_clean":"2024-01-19T04:31:42.217797+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T04:31:42.217797+0000","last_undegraded":"2024-01-19T04:31:42.217797+0000","last_fullsized":"2024-01-19T04:31:42.217797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.427220+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T04:32:20.427220+0000","last_peered":"2024-01-19T04:32:20.427220+0000","last_clean":"2024-01-19T04:32:20.427220+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T04:32:20.427220+0000","last_undegraded":"2024-01-19T04:32:20.427220+0000","last_fullsized":"2024-01-19T04:32:20.427220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667121+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T04:31:39.667121+0000","last_peered":"2024-01-19T04:31:39.667121+0000","last_clean":"2024-01-19T04:31:39.667121+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T04:31:39.667121+0000","last_undegraded":"2024-01-19T04:31:39.667121+0000","last_fullsized":"2024-01-19T04:31:39.667121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223120+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T04:31:42.223120+0000","last_peered":"2024-01-19T04:31:42.223120+0000","last_clean":"2024-01-19T04:31:42.223120+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T04:31:42.223120+0000","last_undegraded":"2024-01-19T04:31:42.223120+0000","last_fullsized":"2024-01-19T04:31:42.223120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978611+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T04:31:40.978611+0000","last_peered":"2024-01-19T04:31:40.978611+0000","last_clean":"2024-01-19T04:31:40.978611+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T04:31:40.978611+0000","last_undegraded":"2024-01-19T04:31:40.978611+0000","last_fullsized":"2024-01-19T04:31:40.978611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667803+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T04:31:39.667803+0000","last_peered":"2024-01-19T04:31:39.667803+0000","last_clean":"2024-01-19T04:31:39.667803+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T04:31:39.667803+0000","last_undegraded":"2024-01-19T04:31:39.667803+0000","last_fullsized":"2024-01-19T04:31:39.667803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218929+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T04:31:42.218929+0000","last_peered":"2024-01-19T04:31:42.218929+0000","last_clean":"2024-01-19T04:31:42.218929+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T04:31:42.218929+0000","last_undegraded":"2024-01-19T04:31:42.218929+0000","last_fullsized":"2024-01-19T04:31:42.218929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.010875+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T04:31:41.010875+0000","last_peered":"2024-01-19T04:31:41.010875+0000","last_clean":"2024-01-19T04:31:41.010875+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T04:31:41.010875+0000","last_undegraded":"2024-01-19T04:31:41.010875+0000","last_fullsized":"2024-01-19T04:31:41.010875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934161+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T04:32:12.934161+0000","last_peered":"2024-01-19T04:32:12.934161+0000","last_clean":"2024-01-19T04:32:12.934161+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T04:32:12.934161+0000","last_undegraded":"2024-01-19T04:32:12.934161+0000","last_fullsized":"2024-01-19T04:32:12.934161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222921+0000","last_change":"2024-01-19T04:31:39.820690+0000","last_active":"2024-01-19T04:31:42.222921+0000","last_peered":"2024-01-19T04:31:42.222921+0000","last_clean":"2024-01-19T04:31:42.222921+0000","last_became_active":"2024-01-19T04:31:39.820114+0000","last_became_peered":"2024-01-19T04:31:39.820114+0000","last_unstale":"2024-01-19T04:31:42.222921+0000","last_undegraded":"2024-01-19T04:31:42.222921+0000","last_fullsized":"2024-01-19T04:31:42.222921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817855+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T04:31:39.817855+0000","last_peered":"2024-01-19T04:31:39.817855+0000","last_clean":"2024-01-19T04:31:39.817855+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T04:31:39.817855+0000","last_undegraded":"2024-01-19T04:31:39.817855+0000","last_fullsized":"2024-01-19T04:31:39.817855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:19.798409+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T04:32:19.798409+0000","last_peered":"2024-01-19T04:32:19.798409+0000","last_clean":"2024-01-19T04:32:19.798409+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T04:32:19.798409+0000","last_undegraded":"2024-01-19T04:32:19.798409+0000","last_fullsized":"2024-01-19T04:32:19.798409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.219094+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T04:31:42.219094+0000","last_peered":"2024-01-19T04:31:42.219094+0000","last_clean":"2024-01-19T04:31:42.219094+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T04:31:42.219094+0000","last_undegraded":"2024-01-19T04:31:42.219094+0000","last_fullsized":"2024-01-19T04:31:42.219094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813733+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T04:31:39.813733+0000","last_peered":"2024-01-19T04:31:39.813733+0000","last_clean":"2024-01-19T04:31:39.813733+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T04:31:39.813733+0000","last_undegraded":"2024-01-19T04:31:39.813733+0000","last_fullsized":"2024-01-19T04:31:39.813733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:24.657469+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T04:32:24.657469+0000","last_peered":"2024-01-19T04:32:24.657469+0000","last_clean":"2024-01-19T04:32:24.657469+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T04:32:24.657469+0000","last_undegraded":"2024-01-19T04:32:24.657469+0000","last_fullsized":"2024-01-19T04:32:24.657469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286153+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T04:31:41.286153+0000","last_peered":"2024-01-19T04:31:41.286153+0000","last_clean":"2024-01-19T04:31:41.286153+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T04:31:41.286153+0000","last_undegraded":"2024-01-19T04:31:41.286153+0000","last_fullsized":"2024-01-19T04:31:41.286153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103858+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T04:31:41.103858+0000","last_peered":"2024-01-19T04:31:41.103858+0000","last_clean":"2024-01-19T04:31:41.103858+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T04:31:41.103858+0000","last_undegraded":"2024-01-19T04:31:41.103858+0000","last_fullsized":"2024-01-19T04:31:41.103858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934190+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T04:32:12.934190+0000","last_peered":"2024-01-19T04:32:12.934190+0000","last_clean":"2024-01-19T04:32:12.934190+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T04:32:12.934190+0000","last_undegraded":"2024-01-19T04:32:12.934190+0000","last_fullsized":"2024-01-19T04:32:12.934190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218706+0000","last_change":"2024-01-19T04:31:39.836900+0000","last_active":"2024-01-19T04:31:42.218706+0000","last_peered":"2024-01-19T04:31:42.218706+0000","last_clean":"2024-01-19T04:31:42.218706+0000","last_became_active":"2024-01-19T04:31:39.834989+0000","last_became_peered":"2024-01-19T04:31:39.834989+0000","last_unstale":"2024-01-19T04:31:42.218706+0000","last_undegraded":"2024-01-19T04:31:42.218706+0000","last_fullsized":"2024-01-19T04:31:42.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:18.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726309+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T04:31:39.726309+0000","last_peered":"2024-01-19T04:31:39.726309+0000","last_clean":"2024-01-19T04:31:39.726309+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T04:31:39.726309+0000","last_undegraded":"2024-01-19T04:31:39.726309+0000","last_fullsized":"2024-01-19T04:31:39.726309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934913+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T04:32:12.934913+0000","last_peered":"2024-01-19T04:32:12.934913+0000","last_clean":"2024-01-19T04:32:12.934913+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T04:32:12.934913+0000","last_undegraded":"2024-01-19T04:32:12.934913+0000","last_fullsized":"2024-01-19T04:32:12.934913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218365+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T04:31:42.218365+0000","last_peered":"2024-01-19T04:31:42.218365+0000","last_clean":"2024-01-19T04:31:42.218365+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T04:31:42.218365+0000","last_undegraded":"2024-01-19T04:31:42.218365+0000","last_fullsized":"2024-01-19T04:31:42.218365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821854+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T04:31:39.821854+0000","last_peered":"2024-01-19T04:31:39.821854+0000","last_clean":"2024-01-19T04:31:39.821854+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T04:31:39.821854+0000","last_undegraded":"2024-01-19T04:31:39.821854+0000","last_fullsized":"2024-01-19T04:31:39.821854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'7","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:24.659225+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T04:32:24.659225+0000","last_peered":"2024-01-19T04:32:24.659225+0000","last_clean":"2024-01-19T04:32:24.659225+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T04:32:24.659225+0000","last_undegraded":"2024-01-19T04:32:24.659225+0000","last_fullsized":"2024-01-19T04:32:24.659225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.645798+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T04:31:41.645798+0000","last_peered":"2024-01-19T04:31:41.645798+0000","last_clean":"2024-01-19T04:31:41.645798+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T04:31:41.645798+0000","last_undegraded":"2024-01-19T04:31:41.645798+0000","last_fullsized":"2024-01-19T04:31:41.645798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821924+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T04:31:39.821924+0000","last_peered":"2024-01-19T04:31:39.821924+0000","last_clean":"2024-01-19T04:31:39.821924+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T04:31:39.821924+0000","last_undegraded":"2024-01-19T04:31:39.821924+0000","last_fullsized":"2024-01-19T04:31:39.821924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.254651+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T04:31:41.254651+0000","last_peered":"2024-01-19T04:31:41.254651+0000","last_clean":"2024-01-19T04:31:41.254651+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T04:31:41.254651+0000","last_undegraded":"2024-01-19T04:31:41.254651+0000","last_fullsized":"2024-01-19T04:31:41.254651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.215923+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T04:31:42.215923+0000","last_peered":"2024-01-19T04:31:42.215923+0000","last_clean":"2024-01-19T04:31:42.215923+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T04:31:42.215923+0000","last_undegraded":"2024-01-19T04:31:42.215923+0000","last_fullsized":"2024-01-19T04:31:42.215923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667922+0000","last_change":"2024-01-19T04:31:34.735885+0000","last_active":"2024-01-19T04:31:39.667922+0000","last_peered":"2024-01-19T04:31:39.667922+0000","last_clean":"2024-01-19T04:31:39.667922+0000","last_became_active":"2024-01-19T04:31:34.735325+0000","last_became_peered":"2024-01-19T04:31:34.735325+0000","last_unstale":"2024-01-19T04:31:39.667922+0000","last_undegraded":"2024-01-19T04:31:39.667922+0000","last_fullsized":"2024-01-19T04:31:39.667922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:04.694015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286941+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T04:31:41.286941+0000","last_peered":"2024-01-19T04:31:41.286941+0000","last_clean":"2024-01-19T04:31:41.286941+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T04:31:41.286941+0000","last_undegraded":"2024-01-19T04:31:41.286941+0000","last_fullsized":"2024-01-19T04:31:41.286941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.284616+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T04:31:41.284616+0000","last_peered":"2024-01-19T04:31:41.284616+0000","last_clean":"2024-01-19T04:31:41.284616+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T04:31:41.284616+0000","last_undegraded":"2024-01-19T04:31:41.284616+0000","last_fullsized":"2024-01-19T04:31:41.284616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103444+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T04:31:41.103444+0000","last_peered":"2024-01-19T04:31:41.103444+0000","last_clean":"2024-01-19T04:31:41.103444+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T04:31:41.103444+0000","last_undegraded":"2024-01-19T04:31:41.103444+0000","last_fullsized":"2024-01-19T04:31:41.103444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.221279+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T04:31:42.221279+0000","last_peered":"2024-01-19T04:31:42.221279+0000","last_clean":"2024-01-19T04:31:42.221279+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T04:31:42.221279+0000","last_undegraded":"2024-01-19T04:31:42.221279+0000","last_fullsized":"2024-01-19T04:31:42.221279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286942+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T04:31:41.286942+0000","last_peered":"2024-01-19T04:31:41.286942+0000","last_clean":"2024-01-19T04:31:41.286942+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T04:31:41.286942+0000","last_undegraded":"2024-01-19T04:31:41.286942+0000","last_fullsized":"2024-01-19T04:31:41.286942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820565+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T04:31:39.820565+0000","last_peered":"2024-01-19T04:31:39.820565+0000","last_clean":"2024-01-19T04:31:39.820565+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T04:31:39.820565+0000","last_undegraded":"2024-01-19T04:31:39.820565+0000","last_fullsized":"2024-01-19T04:31:39.820565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.430340+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T04:32:20.430340+0000","last_peered":"2024-01-19T04:32:20.430340+0000","last_clean":"2024-01-19T04:32:20.430340+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T04:32:20.430340+0000","last_undegraded":"2024-01-19T04:32:20.430340+0000","last_fullsized":"2024-01-19T04:32:20.430340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286650+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T04:31:41.286650+0000","last_peered":"2024-01-19T04:31:41.286650+0000","last_clean":"2024-01-19T04:31:41.286650+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T04:31:41.286650+0000","last_undegraded":"2024-01-19T04:31:41.286650+0000","last_fullsized":"2024-01-19T04:31:41.286650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724790+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T04:31:39.724790+0000","last_peered":"2024-01-19T04:31:39.724790+0000","last_clean":"2024-01-19T04:31:39.724790+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T04:31:39.724790+0000","last_undegraded":"2024-01-19T04:31:39.724790+0000","last_fullsized":"2024-01-19T04:31:39.724790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.427801+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T04:32:20.427801+0000","last_peered":"2024-01-19T04:32:20.427801+0000","last_clean":"2024-01-19T04:32:20.427801+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T04:32:20.427801+0000","last_undegraded":"2024-01-19T04:32:20.427801+0000","last_fullsized":"2024-01-19T04:32:20.427801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216628+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T04:31:42.216628+0000","last_peered":"2024-01-19T04:31:42.216628+0000","last_clean":"2024-01-19T04:31:42.216628+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T04:31:42.216628+0000","last_undegraded":"2024-01-19T04:31:42.216628+0000","last_fullsized":"2024-01-19T04:31:42.216628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817644+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T04:31:39.817644+0000","last_peered":"2024-01-19T04:31:39.817644+0000","last_clean":"2024-01-19T04:31:39.817644+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T04:31:39.817644+0000","last_undegraded":"2024-01-19T04:31:39.817644+0000","last_fullsized":"2024-01-19T04:31:39.817644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.946432+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T04:32:12.946432+0000","last_peered":"2024-01-19T04:32:12.946432+0000","last_clean":"2024-01-19T04:32:12.946432+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T04:32:12.946432+0000","last_undegraded":"2024-01-19T04:32:12.946432+0000","last_fullsized":"2024-01-19T04:32:12.946432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979498+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:31:40.979498+0000","last_peered":"2024-01-19T04:31:40.979498+0000","last_clean":"2024-01-19T04:31:40.979498+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:31:40.979498+0000","last_undegraded":"2024-01-19T04:31:40.979498+0000","last_fullsized":"2024-01-19T04:31:40.979498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.221624+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T04:31:42.221624+0000","last_peered":"2024-01-19T04:31:42.221624+0000","last_clean":"2024-01-19T04:31:42.221624+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T04:31:42.221624+0000","last_undegraded":"2024-01-19T04:31:42.221624+0000","last_fullsized":"2024-01-19T04:31:42.221624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978524+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T04:31:40.978524+0000","last_peered":"2024-01-19T04:31:40.978524+0000","last_clean":"2024-01-19T04:31:40.978524+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T04:31:40.978524+0000","last_undegraded":"2024-01-19T04:31:40.978524+0000","last_fullsized":"2024-01-19T04:31:40.978524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:24.739319+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T04:32:24.739319+0000","last_peered":"2024-01-19T04:32:24.739319+0000","last_clean":"2024-01-19T04:32:24.739319+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T04:32:24.739319+0000","last_undegraded":"2024-01-19T04:32:24.739319+0000","last_fullsized":"2024-01-19T04:32:24.739319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216922+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T04:31:42.216922+0000","last_peered":"2024-01-19T04:31:42.216922+0000","last_clean":"2024-01-19T04:31:42.216922+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T04:31:42.216922+0000","last_undegraded":"2024-01-19T04:31:42.216922+0000","last_fullsized":"2024-01-19T04:31:42.216922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.667067+0000","last_change":"2024-01-19T04:31:34.736261+0000","last_active":"2024-01-19T04:31:39.667067+0000","last_peered":"2024-01-19T04:31:39.667067+0000","last_clean":"2024-01-19T04:31:39.667067+0000","last_became_active":"2024-01-19T04:31:34.735525+0000","last_became_peered":"2024-01-19T04:31:34.735525+0000","last_unstale":"2024-01-19T04:31:39.667067+0000","last_undegraded":"2024-01-19T04:31:39.667067+0000","last_fullsized":"2024-01-19T04:31:39.667067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:41.517467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.286509+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T04:31:41.286509+0000","last_peered":"2024-01-19T04:31:41.286509+0000","last_clean":"2024-01-19T04:31:41.286509+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T04:31:41.286509+0000","last_undegraded":"2024-01-19T04:31:41.286509+0000","last_fullsized":"2024-01-19T04:31:41.286509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216080+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T04:31:42.216080+0000","last_peered":"2024-01-19T04:31:42.216080+0000","last_clean":"2024-01-19T04:31:42.216080+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T04:31:42.216080+0000","last_undegraded":"2024-01-19T04:31:42.216080+0000","last_fullsized":"2024-01-19T04:31:42.216080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979841+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T04:31:40.979841+0000","last_peered":"2024-01-19T04:31:40.979841+0000","last_clean":"2024-01-19T04:31:40.979841+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T04:31:40.979841+0000","last_undegraded":"2024-01-19T04:31:40.979841+0000","last_fullsized":"2024-01-19T04:31:40.979841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275868+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T04:31:41.275868+0000","last_peered":"2024-01-19T04:31:41.275868+0000","last_clean":"2024-01-19T04:31:41.275868+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T04:31:41.275868+0000","last_undegraded":"2024-01-19T04:31:41.275868+0000","last_fullsized":"2024-01-19T04:31:41.275868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217615+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T04:31:42.217615+0000","last_peered":"2024-01-19T04:31:42.217615+0000","last_clean":"2024-01-19T04:31:42.217615+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T04:31:42.217615+0000","last_undegraded":"2024-01-19T04:31:42.217615+0000","last_fullsized":"2024-01-19T04:31:42.217615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979462+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T04:31:40.979462+0000","last_peered":"2024-01-19T04:31:40.979462+0000","last_clean":"2024-01-19T04:31:40.979462+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T04:31:40.979462+0000","last_undegraded":"2024-01-19T04:31:40.979462+0000","last_fullsized":"2024-01-19T04:31:40.979462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104895+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T04:31:41.104895+0000","last_peered":"2024-01-19T04:31:41.104895+0000","last_clean":"2024-01-19T04:31:41.104895+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T04:31:41.104895+0000","last_undegraded":"2024-01-19T04:31:41.104895+0000","last_fullsized":"2024-01-19T04:31:41.104895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.217971+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T04:31:42.217971+0000","last_peered":"2024-01-19T04:31:42.217971+0000","last_clean":"2024-01-19T04:31:42.217971+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T04:31:42.217971+0000","last_undegraded":"2024-01-19T04:31:42.217971+0000","last_fullsized":"2024-01-19T04:31:42.217971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978224+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T04:31:40.978224+0000","last_peered":"2024-01-19T04:31:40.978224+0000","last_clean":"2024-01-19T04:31:40.978224+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T04:31:40.978224+0000","last_undegraded":"2024-01-19T04:31:40.978224+0000","last_fullsized":"2024-01-19T04:31:40.978224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'16","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.526924+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T04:32:20.526924+0000","last_peered":"2024-01-19T04:32:20.526924+0000","last_clean":"2024-01-19T04:32:20.526924+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T04:32:20.526924+0000","last_undegraded":"2024-01-19T04:32:20.526924+0000","last_fullsized":"2024-01-19T04:32:20.526924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216542+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T04:31:42.216542+0000","last_peered":"2024-01-19T04:31:42.216542+0000","last_clean":"2024-01-19T04:31:42.216542+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T04:31:42.216542+0000","last_undegraded":"2024-01-19T04:31:42.216542+0000","last_fullsized":"2024-01-19T04:31:42.216542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008763+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T04:31:41.008763+0000","last_peered":"2024-01-19T04:31:41.008763+0000","last_clean":"2024-01-19T04:31:41.008763+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T04:31:41.008763+0000","last_undegraded":"2024-01-19T04:31:41.008763+0000","last_fullsized":"2024-01-19T04:31:41.008763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.565878+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T04:32:20.565878+0000","last_peered":"2024-01-19T04:32:20.565878+0000","last_clean":"2024-01-19T04:32:20.565878+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T04:32:20.565878+0000","last_undegraded":"2024-01-19T04:32:20.565878+0000","last_fullsized":"2024-01-19T04:32:20.565878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.648374+0000","last_change":"2024-01-19T04:31:39.841628+0000","last_active":"2024-01-19T04:31:41.648374+0000","last_peered":"2024-01-19T04:31:41.648374+0000","last_clean":"2024-01-19T04:31:41.648374+0000","last_became_active":"2024-01-19T04:31:39.841239+0000","last_became_peered":"2024-01-19T04:31:39.841239+0000","last_unstale":"2024-01-19T04:31:41.648374+0000","last_undegraded":"2024-01-19T04:31:41.648374+0000","last_fullsized":"2024-01-19T04:31:41.648374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:26:24.623871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978985+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T04:31:40.978985+0000","last_peered":"2024-01-19T04:31:40.978985+0000","last_clean":"2024-01-19T04:31:40.978985+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T04:31:40.978985+0000","last_undegraded":"2024-01-19T04:31:40.978985+0000","last_fullsized":"2024-01-19T04:31:40.978985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.943944+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T04:32:12.943944+0000","last_peered":"2024-01-19T04:32:12.943944+0000","last_clean":"2024-01-19T04:32:12.943944+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T04:32:12.943944+0000","last_undegraded":"2024-01-19T04:32:12.943944+0000","last_fullsized":"2024-01-19T04:32:12.943944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647710+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T04:31:41.647710+0000","last_peered":"2024-01-19T04:31:41.647710+0000","last_clean":"2024-01-19T04:31:41.647710+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T04:31:41.647710+0000","last_undegraded":"2024-01-19T04:31:41.647710+0000","last_fullsized":"2024-01-19T04:31:41.647710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724950+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T04:31:39.724950+0000","last_peered":"2024-01-19T04:31:39.724950+0000","last_clean":"2024-01-19T04:31:39.724950+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T04:31:39.724950+0000","last_undegraded":"2024-01-19T04:31:39.724950+0000","last_fullsized":"2024-01-19T04:31:39.724950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.490062+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T04:32:20.490062+0000","last_peered":"2024-01-19T04:32:20.490062+0000","last_clean":"2024-01-19T04:32:20.490062+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T04:32:20.490062+0000","last_undegraded":"2024-01-19T04:32:20.490062+0000","last_fullsized":"2024-01-19T04:32:20.490062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222496+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T04:31:42.222496+0000","last_peered":"2024-01-19T04:31:42.222496+0000","last_clean":"2024-01-19T04:31:42.222496+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T04:31:42.222496+0000","last_undegraded":"2024-01-19T04:31:42.222496+0000","last_fullsized":"2024-01-19T04:31:42.222496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978551+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T04:31:40.978551+0000","last_peered":"2024-01-19T04:31:40.978551+0000","last_clean":"2024-01-19T04:31:40.978551+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T04:31:40.978551+0000","last_undegraded":"2024-01-19T04:31:40.978551+0000","last_fullsized":"2024-01-19T04:31:40.978551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.933754+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T04:32:12.933754+0000","last_peered":"2024-01-19T04:32:12.933754+0000","last_clean":"2024-01-19T04:32:12.933754+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T04:32:12.933754+0000","last_undegraded":"2024-01-19T04:32:12.933754+0000","last_fullsized":"2024-01-19T04:32:12.933754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.285152+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T04:31:41.285152+0000","last_peered":"2024-01-19T04:31:41.285152+0000","last_clean":"2024-01-19T04:31:41.285152+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T04:31:41.285152+0000","last_undegraded":"2024-01-19T04:31:41.285152+0000","last_fullsized":"2024-01-19T04:31:41.285152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104147+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T04:31:41.104147+0000","last_peered":"2024-01-19T04:31:41.104147+0000","last_clean":"2024-01-19T04:31:41.104147+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T04:31:41.104147+0000","last_undegraded":"2024-01-19T04:31:41.104147+0000","last_fullsized":"2024-01-19T04:31:41.104147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.070079+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T04:32:13.070079+0000","last_peered":"2024-01-19T04:32:13.070079+0000","last_clean":"2024-01-19T04:32:13.070079+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T04:32:13.070079+0000","last_undegraded":"2024-01-19T04:32:13.070079+0000","last_fullsized":"2024-01-19T04:32:13.070079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.223324+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T04:31:42.223324+0000","last_peered":"2024-01-19T04:31:42.223324+0000","last_clean":"2024-01-19T04:31:42.223324+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T04:31:42.223324+0000","last_undegraded":"2024-01-19T04:31:42.223324+0000","last_fullsized":"2024-01-19T04:31:42.223324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.726771+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T04:31:39.726771+0000","last_peered":"2024-01-19T04:31:39.726771+0000","last_clean":"2024-01-19T04:31:39.726771+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T04:31:39.726771+0000","last_undegraded":"2024-01-19T04:31:39.726771+0000","last_fullsized":"2024-01-19T04:31:39.726771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.941821+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T04:32:12.941821+0000","last_peered":"2024-01-19T04:32:12.941821+0000","last_clean":"2024-01-19T04:32:12.941821+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T04:32:12.941821+0000","last_undegraded":"2024-01-19T04:32:12.941821+0000","last_fullsized":"2024-01-19T04:32:12.941821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646384+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T04:31:41.646384+0000","last_peered":"2024-01-19T04:31:41.646384+0000","last_clean":"2024-01-19T04:31:41.646384+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T04:31:41.646384+0000","last_undegraded":"2024-01-19T04:31:41.646384+0000","last_fullsized":"2024-01-19T04:31:41.646384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668228+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T04:31:39.668228+0000","last_peered":"2024-01-19T04:31:39.668228+0000","last_clean":"2024-01-19T04:31:39.668228+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T04:31:39.668228+0000","last_undegraded":"2024-01-19T04:31:39.668228+0000","last_fullsized":"2024-01-19T04:31:39.668228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:12.934809+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T04:32:12.934809+0000","last_peered":"2024-01-19T04:32:12.934809+0000","last_clean":"2024-01-19T04:32:12.934809+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T04:32:12.934809+0000","last_undegraded":"2024-01-19T04:32:12.934809+0000","last_fullsized":"2024-01-19T04:32:12.934809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.646461+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T04:31:41.646461+0000","last_peered":"2024-01-19T04:31:41.646461+0000","last_clean":"2024-01-19T04:31:41.646461+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T04:31:41.646461+0000","last_undegraded":"2024-01-19T04:31:41.646461+0000","last_fullsized":"2024-01-19T04:31:41.646461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.216448+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T04:31:42.216448+0000","last_peered":"2024-01-19T04:31:42.216448+0000","last_clean":"2024-01-19T04:31:42.216448+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T04:31:42.216448+0000","last_undegraded":"2024-01-19T04:31:42.216448+0000","last_fullsized":"2024-01-19T04:31:42.216448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820389+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T04:31:39.820389+0000","last_peered":"2024-01-19T04:31:39.820389+0000","last_clean":"2024-01-19T04:31:39.820389+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T04:31:39.820389+0000","last_undegraded":"2024-01-19T04:31:39.820389+0000","last_fullsized":"2024-01-19T04:31:39.820389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.218875+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T04:31:42.218875+0000","last_peered":"2024-01-19T04:31:42.218875+0000","last_clean":"2024-01-19T04:31:42.218875+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T04:31:42.218875+0000","last_undegraded":"2024-01-19T04:31:42.218875+0000","last_fullsized":"2024-01-19T04:31:42.218875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:42.222235+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T04:31:42.222235+0000","last_peered":"2024-01-19T04:31:42.222235+0000","last_clean":"2024-01-19T04:31:42.222235+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T04:31:42.222235+0000","last_undegraded":"2024-01-19T04:31:42.222235+0000","last_fullsized":"2024-01-19T04:31:42.222235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813740+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T04:31:39.813740+0000","last_peered":"2024-01-19T04:31:39.813740+0000","last_clean":"2024-01-19T04:31:39.813740+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T04:31:39.813740+0000","last_undegraded":"2024-01-19T04:31:39.813740+0000","last_fullsized":"2024-01-19T04:31:39.813740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.424222+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T04:32:20.424222+0000","last_peered":"2024-01-19T04:32:20.424222+0000","last_clean":"2024-01-19T04:32:20.424222+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T04:32:20.424222+0000","last_undegraded":"2024-01-19T04:32:20.424222+0000","last_fullsized":"2024-01-19T04:32:20.424222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:20.565540+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T04:32:20.565540+0000","last_peered":"2024-01-19T04:32:20.565540+0000","last_clean":"2024-01-19T04:32:20.565540+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T04:32:20.565540+0000","last_undegraded":"2024-01-19T04:32:20.565540+0000","last_fullsized":"2024-01-19T04:32:20.565540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725708+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T04:31:39.725708+0000","last_peered":"2024-01-19T04:31:39.725708+0000","last_clean":"2024-01-19T04:31:39.725708+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T04:31:39.725708+0000","last_undegraded":"2024-01-19T04:31:39.725708+0000","last_fullsized":"2024-01-19T04:31:39.725708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.275109+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T04:31:41.275109+0000","last_peered":"2024-01-19T04:31:41.275109+0000","last_clean":"2024-01-19T04:31:41.275109+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T04:31:41.275109+0000","last_undegraded":"2024-01-19T04:31:41.275109+0000","last_fullsized":"2024-01-19T04:31:41.275109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:32:13.064237+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T04:32:13.064237+0000","last_peered":"2024-01-19T04:32:13.064237+0000","last_clean":"2024-01-19T04:32:13.064237+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T04:32:13.064237+0000","last_undegraded":"2024-01-19T04:32:13.064237+0000","last_fullsized":"2024-01-19T04:32:13.064237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.103673+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T04:31:41.103673+0000","last_peered":"2024-01-19T04:31:41.103673+0000","last_clean":"2024-01-19T04:31:41.103673+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T04:31:41.103673+0000","last_undegraded":"2024-01-19T04:31:41.103673+0000","last_fullsized":"2024-01-19T04:31:41.103673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.647676+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T04:31:41.647676+0000","last_peered":"2024-01-19T04:31:41.647676+0000","last_clean":"2024-01-19T04:31:41.647676+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T04:31:41.647676+0000","last_undegraded":"2024-01-19T04:31:41.647676+0000","last_fullsized":"2024-01-19T04:31:41.647676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008510+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T04:31:41.008510+0000","last_peered":"2024-01-19T04:31:41.008510+0000","last_clean":"2024-01-19T04:31:41.008510+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T04:31:41.008510+0000","last_undegraded":"2024-01-19T04:31:41.008510+0000","last_fullsized":"2024-01-19T04:31:41.008510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.812464+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T04:31:39.812464+0000","last_peered":"2024-01-19T04:31:39.812464+0000","last_clean":"2024-01-19T04:31:39.812464+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T04:31:39.812464+0000","last_undegraded":"2024-01-19T04:31:39.812464+0000","last_fullsized":"2024-01-19T04:31:39.812464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666159+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T04:31:39.666159+0000","last_peered":"2024-01-19T04:31:39.666159+0000","last_clean":"2024-01-19T04:31:39.666159+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T04:31:39.666159+0000","last_undegraded":"2024-01-19T04:31:39.666159+0000","last_fullsized":"2024-01-19T04:31:39.666159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725587+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T04:31:39.725587+0000","last_peered":"2024-01-19T04:31:39.725587+0000","last_clean":"2024-01-19T04:31:39.725587+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T04:31:39.725587+0000","last_undegraded":"2024-01-19T04:31:39.725587+0000","last_fullsized":"2024-01-19T04:31:39.725587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821683+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T04:31:39.821683+0000","last_peered":"2024-01-19T04:31:39.821683+0000","last_clean":"2024-01-19T04:31:39.821683+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T04:31:39.821683+0000","last_undegraded":"2024-01-19T04:31:39.821683+0000","last_fullsized":"2024-01-19T04:31:39.821683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822108+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T04:31:39.822108+0000","last_peered":"2024-01-19T04:31:39.822108+0000","last_clean":"2024-01-19T04:31:39.822108+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T04:31:39.822108+0000","last_undegraded":"2024-01-19T04:31:39.822108+0000","last_fullsized":"2024-01-19T04:31:39.822108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009546+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T04:31:41.009546+0000","last_peered":"2024-01-19T04:31:41.009546+0000","last_clean":"2024-01-19T04:31:41.009546+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T04:31:41.009546+0000","last_undegraded":"2024-01-19T04:31:41.009546+0000","last_fullsized":"2024-01-19T04:31:41.009546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.821774+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T04:31:39.821774+0000","last_peered":"2024-01-19T04:31:39.821774+0000","last_clean":"2024-01-19T04:31:39.821774+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T04:31:39.821774+0000","last_undegraded":"2024-01-19T04:31:39.821774+0000","last_fullsized":"2024-01-19T04:31:39.821774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666053+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T04:31:39.666053+0000","last_peered":"2024-01-19T04:31:39.666053+0000","last_clean":"2024-01-19T04:31:39.666053+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T04:31:39.666053+0000","last_undegraded":"2024-01-19T04:31:39.666053+0000","last_fullsized":"2024-01-19T04:31:39.666053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817657+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T04:31:39.817657+0000","last_peered":"2024-01-19T04:31:39.817657+0000","last_clean":"2024-01-19T04:31:39.817657+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T04:31:39.817657+0000","last_undegraded":"2024-01-19T04:31:39.817657+0000","last_fullsized":"2024-01-19T04:31:39.817657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665952+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T04:31:39.665952+0000","last_peered":"2024-01-19T04:31:39.665952+0000","last_clean":"2024-01-19T04:31:39.665952+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T04:31:39.665952+0000","last_undegraded":"2024-01-19T04:31:39.665952+0000","last_fullsized":"2024-01-19T04:31:39.665952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.725169+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T04:31:39.725169+0000","last_peered":"2024-01-19T04:31:39.725169+0000","last_clean":"2024-01-19T04:31:39.725169+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T04:31:39.725169+0000","last_undegraded":"2024-01-19T04:31:39.725169+0000","last_fullsized":"2024-01-19T04:31:39.725169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.008993+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T04:31:41.008993+0000","last_peered":"2024-01-19T04:31:41.008993+0000","last_clean":"2024-01-19T04:31:41.008993+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T04:31:41.008993+0000","last_undegraded":"2024-01-19T04:31:41.008993+0000","last_fullsized":"2024-01-19T04:31:41.008993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979162+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T04:31:40.979162+0000","last_peered":"2024-01-19T04:31:40.979162+0000","last_clean":"2024-01-19T04:31:40.979162+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T04:31:40.979162+0000","last_undegraded":"2024-01-19T04:31:40.979162+0000","last_fullsized":"2024-01-19T04:31:40.979162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.813279+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T04:31:39.813279+0000","last_peered":"2024-01-19T04:31:39.813279+0000","last_clean":"2024-01-19T04:31:39.813279+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T04:31:39.813279+0000","last_undegraded":"2024-01-19T04:31:39.813279+0000","last_fullsized":"2024-01-19T04:31:39.813279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.668465+0000","last_change":"2024-01-19T04:31:34.743868+0000","last_active":"2024-01-19T04:31:39.668465+0000","last_peered":"2024-01-19T04:31:39.668465+0000","last_clean":"2024-01-19T04:31:39.668465+0000","last_became_active":"2024-01-19T04:31:34.743503+0000","last_became_peered":"2024-01-19T04:31:34.743503+0000","last_unstale":"2024-01-19T04:31:39.668465+0000","last_undegraded":"2024-01-19T04:31:39.668465+0000","last_fullsized":"2024-01-19T04:31:39.668465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:22.598439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665835+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T04:31:39.665835+0000","last_peered":"2024-01-19T04:31:39.665835+0000","last_clean":"2024-01-19T04:31:39.665835+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T04:31:39.665835+0000","last_undegraded":"2024-01-19T04:31:39.665835+0000","last_fullsized":"2024-01-19T04:31:39.665835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.820435+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T04:31:39.820435+0000","last_peered":"2024-01-19T04:31:39.820435+0000","last_clean":"2024-01-19T04:31:39.820435+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T04:31:39.820435+0000","last_undegraded":"2024-01-19T04:31:39.820435+0000","last_fullsized":"2024-01-19T04:31:39.820435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724966+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T04:31:39.724966+0000","last_peered":"2024-01-19T04:31:39.724966+0000","last_clean":"2024-01-19T04:31:39.724966+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T04:31:39.724966+0000","last_undegraded":"2024-01-19T04:31:39.724966+0000","last_fullsized":"2024-01-19T04:31:39.724966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.817772+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T04:31:39.817772+0000","last_peered":"2024-01-19T04:31:39.817772+0000","last_clean":"2024-01-19T04:31:39.817772+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T04:31:39.817772+0000","last_undegraded":"2024-01-19T04:31:39.817772+0000","last_fullsized":"2024-01-19T04:31:39.817772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.104062+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T04:31:41.104062+0000","last_peered":"2024-01-19T04:31:41.104062+0000","last_clean":"2024-01-19T04:31:41.104062+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T04:31:41.104062+0000","last_undegraded":"2024-01-19T04:31:41.104062+0000","last_fullsized":"2024-01-19T04:31:41.104062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009588+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T04:31:41.009588+0000","last_peered":"2024-01-19T04:31:41.009588+0000","last_clean":"2024-01-19T04:31:41.009588+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T04:31:41.009588+0000","last_undegraded":"2024-01-19T04:31:41.009588+0000","last_fullsized":"2024-01-19T04:31:41.009588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:41.009336+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T04:31:41.009336+0000","last_peered":"2024-01-19T04:31:41.009336+0000","last_clean":"2024-01-19T04:31:41.009336+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T04:31:41.009336+0000","last_undegraded":"2024-01-19T04:31:41.009336+0000","last_fullsized":"2024-01-19T04:31:41.009336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979732+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T04:31:40.979732+0000","last_peered":"2024-01-19T04:31:40.979732+0000","last_clean":"2024-01-19T04:31:40.979732+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T04:31:40.979732+0000","last_undegraded":"2024-01-19T04:31:40.979732+0000","last_fullsized":"2024-01-19T04:31:40.979732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.809480+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T04:31:39.809480+0000","last_peered":"2024-01-19T04:31:39.809480+0000","last_clean":"2024-01-19T04:31:39.809480+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T04:31:39.809480+0000","last_undegraded":"2024-01-19T04:31:39.809480+0000","last_fullsized":"2024-01-19T04:31:39.809480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978084+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T04:31:40.978084+0000","last_peered":"2024-01-19T04:31:40.978084+0000","last_clean":"2024-01-19T04:31:40.978084+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T04:31:40.978084+0000","last_undegraded":"2024-01-19T04:31:40.978084+0000","last_fullsized":"2024-01-19T04:31:40.978084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.665994+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T04:31:39.665994+0000","last_peered":"2024-01-19T04:31:39.665994+0000","last_clean":"2024-01-19T04:31:39.665994+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T04:31:39.665994+0000","last_undegraded":"2024-01-19T04:31:39.665994+0000","last_fullsized":"2024-01-19T04:31:39.665994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.978264+0000","last_change":"2024-01-19T04:31:33.071431+0000","last_active":"2024-01-19T04:31:40.978264+0000","last_peered":"2024-01-19T04:31:40.978264+0000","last_clean":"2024-01-19T04:31:40.978264+0000","last_became_active":"2024-01-19T04:31:33.070826+0000","last_became_peered":"2024-01-19T04:31:33.070826+0000","last_unstale":"2024-01-19T04:31:40.978264+0000","last_undegraded":"2024-01-19T04:31:40.978264+0000","last_fullsized":"2024-01-19T04:31:40.978264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:36:31.481256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.666838+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T04:31:39.666838+0000","last_peered":"2024-01-19T04:31:39.666838+0000","last_clean":"2024-01-19T04:31:39.666838+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T04:31:39.666838+0000","last_undegraded":"2024-01-19T04:31:39.666838+0000","last_fullsized":"2024-01-19T04:31:39.666838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.724952+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T04:31:39.724952+0000","last_peered":"2024-01-19T04:31:39.724952+0000","last_clean":"2024-01-19T04:31:39.724952+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T04:31:39.724952+0000","last_undegraded":"2024-01-19T04:31:39.724952+0000","last_fullsized":"2024-01-19T04:31:39.724952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-19T04:31:39.822589+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T04:31:39.822589+0000","last_peered":"2024-01-19T04:31:39.822589+0000","last_clean":"2024-01-19T04:31:39.822589+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T04:31:39.822589+0000","last_undegraded":"2024-01-19T04:31:39.822589+0000","last_fullsized":"2024-01-19T04:31:39.822589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-19T04:31:40.979575+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T04:31:40.979575+0000","last_peered":"2024-01-19T04:31:40.979575+0000","last_clean":"2024-01-19T04:31:40.979575+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T04:31:40.979575+0000","last_undegraded":"2024-01-19T04:31:40.979575+0000","last_fullsized":"2024-01-19T04:31:40.979575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8039,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":15490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476760,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":119880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.78600000000000003}]}]},{"osd":1,"up_from":16,"seq":68719476761,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":119418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.3129999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.254},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.099}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.228},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.375}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":122993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.079},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.7309999999999999,"5min":5.7309999999999999,"15min":5.7309999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7850000000000001,"5min":5.7850000000000001,"15min":5.7850000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.88800000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:31:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":4.0140000000000002,"5min":4.0140000000000002,"15min":4.0140000000000002},"last":0.92900000000000005}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":5.6920000000000002,"5min":5.6920000000000002,"15min":5.6920000000000002},"last":1.218}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":119852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.87}]},{"osd":1,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.169},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.133}]},{"osd":3,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.069}]},{"osd":4,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.2250000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:31:53 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.268},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.2909999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":119188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.434}]},{"osd":2,"last update":"Fri Jan 19 04:31:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.623},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.499}]},{"osd":6,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:31:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.60599999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":123027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.88},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.623}]},{"osd":4,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.171}]},{"osd":5,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.103}]},{"osd":7,"last update":"Fri Jan 19 04:31:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0800000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":909312,"data_stored":710158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.88400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.1020000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.044},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75800000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.01}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.073},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1639999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":709502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.623}]},{"osd":2,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.93999999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.111}]},{"osd":5,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:31:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:31:46 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.04}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:32:25.872 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-19T04:32:25.872 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-19T04:32:25.872 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-19T04:32:25.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-19T04:32:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 Processor -- start 2024-01-19T04:32:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 -- start start 2024-01-19T04:32:26.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd180cb370 0x7fdd18071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd180cb750 0x7fdd1814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18071f40 con 0x7fdd180bffd0 2024-01-19T04:32:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180722a0 con 0x7fdd180cb370 2024-01-19T04:32:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd1ca1f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18072580 con 0x7fdd180cb750 2024-01-19T04:32:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd0ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdd180bffd0 0x7fdd18159f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60986/0 (socket says 172.21.15.133:60986) 2024-01-19T04:32:26.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.017+0000 7fdd0ffff640 1 -- 172.21.15.133:0/425255715 learned_addr learned my addr 172.21.15.133:0/425255715 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.021+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289483040 0 0) 0x7fdd18071f40 con 0x7fdd180bffd0 2024-01-19T04:32:26.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.021+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd04005740 con 0x7fdd180bffd0 2024-01-19T04:32:26.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001710817 0 0) 0x7fdd04005740 con 0x7fdd180bffd0 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd180cb750 msgr2=0x7fdd1814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd180cb750 0x7fdd1814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 >> v2:172.21.15.156:3300/0 conn(0x7fdd180cb370 msgr2=0x7fdd18071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 --2- 172.21.15.133:0/425255715 >> v2:172.21.15.156:3300/0 conn(0x7fdd180cb370 0x7fdd18071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18072860 con 0x7fdd180bffd0 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fdd00001680 con 0x7fdd180bffd0 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 >> v1:172.21.15.133:6789/0 conn(0x7fdd180bffd0 legacy=0x7fdd18159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd04005b90 0x7fdd04005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd180cb750 0x7fdd040069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04006f70 0x7fdd040073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180722a0 con 0x7fdd04005b90 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18072580 con 0x7fdd04006f70 2024-01-19T04:32:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.025+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0400de90 con 0x7fdd180cb750 2024-01-19T04:32:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.029+0000 7fdd1659c640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd04005b90 0x7fdd04005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.029+0000 7fdd1659c640 1 -- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd180cb750 msgr2=0x7fdd040069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.029+0000 7fdd1659c640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd180cb750 0x7fdd040069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.029+0000 7fdd1659c640 1 -- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04006f70 msgr2=0x7fdd040073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.029+0000 7fdd1659c640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04006f70 0x7fdd040073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.029+0000 7fdd1659c640 1 -- 172.21.15.133:0/425255715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04005740 con 0x7fdd04005b90 2024-01-19T04:32:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.033+0000 7fdd1659c640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd04005b90 0x7fdd04005fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009890 tx=0x7fdd0801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c951c8d98b6eba5d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:26.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080ab600 con 0x7fdd04005b90 2024-01-19T04:32:26.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd080a7050 con 0x7fdd04005b90 2024-01-19T04:32:26.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd15d9b640 1 -- 172.21.15.133:0/425255715 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080ab9c0 con 0x7fdd04005b90 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/425255715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd04005b90 msgr2=0x7fdd04005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/425255715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd04005b90 0x7fdd04005fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009890 tx=0x7fdd0801c3a0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd16d9d640 1 -- 172.21.15.133:0/425255715 reap_dead start 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/425255715 shutdown_connections 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/425255715 >> 172.21.15.133:0/425255715 conn(0x7fdd1806d590 msgr2=0x7fdd18066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/425255715 shutdown_connections 2024-01-19T04:32:26.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.037+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/425255715 wait complete. 2024-01-19T04:32:26.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 Processor -- start 2024-01-19T04:32:26.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 -- start start 2024-01-19T04:32:26.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04005b90 0x7fdd181eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 0x7fdd181e1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd181e1e40 0x7fdd18157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181efeb0 con 0x7fdd18158c40 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181e22c0 con 0x7fdd04005b90 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd1ca1f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181574d0 con 0x7fdd181e1e40 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd0ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 0x7fdd181e1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd0ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 0x7fdd181e1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58690/0 (socket says 172.21.15.133:58690) 2024-01-19T04:32:26.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.041+0000 7fdd0ffff640 1 -- 172.21.15.133:0/1605042861 learned_addr learned my addr 172.21.15.133:0/1605042861 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:26.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.045+0000 7fdd0ffff640 1 -- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd181e1e40 msgr2=0x7fdd18157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.045+0000 7fdd0ffff640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd181e1e40 0x7fdd18157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.045+0000 7fdd0ffff640 1 -- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04005b90 msgr2=0x7fdd181eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.045+0000 7fdd0ffff640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04005b90 0x7fdd181eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.045+0000 7fdd0ffff640 1 -- 172.21.15.133:0/1605042861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1814f1d0 con 0x7fdd18158c40 2024-01-19T04:32:26.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.049+0000 7fdd0ffff640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 0x7fdd181e1900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000f730 tx=0x7fdd0000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:26.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.049+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00007af0 con 0x7fdd18158c40 2024-01-19T04:32:26.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.049+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00007c50 con 0x7fdd18158c40 2024-01-19T04:32:26.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.049+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd180c9f60 con 0x7fdd18158c40 2024-01-19T04:32:26.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.049+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000a0d0 con 0x7fdd18158c40 2024-01-19T04:32:26.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.049+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd180ca500 con 0x7fdd18158c40 2024-01-19T04:32:26.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.053+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18074340 con 0x7fdd18158c40 2024-01-19T04:32:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.073+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdd0000a230 con 0x7fdd18158c40 2024-01-19T04:32:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.073+0000 7fdd0effd640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdcf8066580 0x7fdcf8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.073+0000 7fdd1659c640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdcf8066580 0x7fdcf8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.073+0000 7fdd1659c640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdcf8066580 0x7fdcf8068a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd080ad000 tx=0x7fdd080047e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:26.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.341+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd00057ff0 con 0x7fdd18158c40 2024-01-19T04:32:26.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.341+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdd00053c30 con 0x7fdd18158c40 2024-01-19T04:32:26.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.525+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdd18148060 con 0x7fdd18158c40 2024-01-19T04:32:26.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.617+0000 7fdd0effd640 1 -- 172.21.15.133:0/1605042861 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdd0001b030 con 0x7fdd18158c40 2024-01-19T04:32:26.617 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:26.618 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-19T04:32:26.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdcf8066580 msgr2=0x7fdcf8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdcf8066580 0x7fdcf8068a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd080ad000 tx=0x7fdd080047e0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 msgr2=0x7fdd181e1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 0x7fdd181e1900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000f730 tx=0x7fdd0000fbf0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 shutdown_connections 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdcf8066580 0x7fdcf8068a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd181e1e40 0x7fdd18157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd18158c40 0x7fdd181e1900 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 --2- 172.21.15.133:0/1605042861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd04005b90 0x7fdd181eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 >> 172.21.15.133:0/1605042861 conn(0x7fdd1806d590 msgr2=0x7fdd180c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 shutdown_connections 2024-01-19T04:32:26.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.621+0000 7fdd1ca1f640 1 -- 172.21.15.133:0/1605042861 wait complete. 2024-01-19T04:32:26.641 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-19T04:32:26.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:26.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.765+0000 7f3f2aade640 1 Processor -- start 2024-01-19T04:32:26.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.765+0000 7f3f2aade640 1 -- start start 2024-01-19T04:32:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.769+0000 7f3f2aade640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3f2414fa50 0x7f3f240cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.769+0000 7f3f2aade640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f24072ce0 con 0x7f3f240710b0 2024-01-19T04:32:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.769+0000 7f3f2aade640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f240c05f0 con 0x7f3f24159af0 2024-01-19T04:32:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.769+0000 7f3f2aade640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f24155a30 con 0x7f3f2414fa50 2024-01-19T04:32:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.769+0000 7f3f23fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3f240710b0 0x7f3f241593e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60988/0 (socket says 172.21.15.133:60988) 2024-01-19T04:32:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.769+0000 7f3f23fff640 1 -- 172.21.15.133:0/3835387718 learned_addr learned my addr 172.21.15.133:0/3835387718 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:26.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.773+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710148222 0 0) 0x7f3f24072ce0 con 0x7f3f240710b0 2024-01-19T04:32:26.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.773+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f0c003530 con 0x7f3f240710b0 2024-01-19T04:32:26.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748047896 0 0) 0x7f3f0c003530 con 0x7f3f240710b0 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 >> v2:172.21.15.156:3300/0 conn(0x7f3f2414fa50 msgr2=0x7f3f240cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 --2- 172.21.15.133:0/3835387718 >> v2:172.21.15.156:3300/0 conn(0x7f3f2414fa50 0x7f3f240cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 >> v1:172.21.15.156:6789/0 conn(0x7f3f24159af0 legacy=0x7f3f240c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24155c40 con 0x7f3f240710b0 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f3f18001680 con 0x7f3f240710b0 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 >> v1:172.21.15.133:6789/0 conn(0x7f3f240710b0 legacy=0x7f3f241593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f0c0047d0 0x7f3f0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0c0052b0 0x7f3f0c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24155a30 con 0x7f3f0c0039d0 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c00e400 con 0x7f3f0c0047d0 2024-01-19T04:32:26.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c00e5c0 con 0x7f3f0c0052b0 2024-01-19T04:32:26.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.777+0000 7f3f2887a640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.781+0000 7f3f2887a640 1 -- 172.21.15.133:0/3835387718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0c0052b0 msgr2=0x7f3f0c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.781+0000 7f3f2887a640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0c0052b0 0x7f3f0c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.781+0000 7f3f2887a640 1 -- 172.21.15.133:0/3835387718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f0c0047d0 msgr2=0x7f3f0c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.781+0000 7f3f2887a640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f0c0047d0 0x7f3f0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.781+0000 7f3f2887a640 1 -- 172.21.15.133:0/3835387718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c003530 con 0x7f3f0c0039d0 2024-01-19T04:32:26.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.781+0000 7f3f2907b640 1 -- 172.21.15.133:0/3835387718 reap_dead start 2024-01-19T04:32:26.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.785+0000 7f3f2887a640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f0c003dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009860 tx=0x7f3f1401c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f788231d37560f12 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.785+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140ab600 con 0x7f3f0c0039d0 2024-01-19T04:32:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f140a7050 con 0x7f3f0c0039d0 2024-01-19T04:32:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f237fe640 1 -- 172.21.15.133:0/3835387718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140ab9c0 con 0x7f3f0c0039d0 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 -- 172.21.15.133:0/3835387718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 msgr2=0x7f3f0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f0c003dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009860 tx=0x7f3f1401c300 comp rx=0 tx=0).stop 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 -- 172.21.15.133:0/3835387718 shutdown_connections 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 --2- 172.21.15.133:0/3835387718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f0c003dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 -- 172.21.15.133:0/3835387718 >> 172.21.15.133:0/3835387718 conn(0x7f3f2406d590 msgr2=0x7f3f24066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 -- 172.21.15.133:0/3835387718 shutdown_connections 2024-01-19T04:32:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 -- 172.21.15.133:0/3835387718 wait complete. 2024-01-19T04:32:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 Processor -- start 2024-01-19T04:32:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.789+0000 7f3f2aade640 1 -- start start 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2aade640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f241580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2aade640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f24141820 0x7f3f2413d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2aade640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2413f330 0x7f3f2413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2aade640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24155620 con 0x7f3f0c0039d0 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2aade640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f241429b0 con 0x7f3f2413f330 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2aade640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24155060 con 0x7f3f24141820 2024-01-19T04:32:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2887a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f241580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2887a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f241580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58698/0 (socket says 172.21.15.133:58698) 2024-01-19T04:32:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.793+0000 7f3f2887a640 1 -- 172.21.15.133:0/242721455 learned_addr learned my addr 172.21.15.133:0/242721455 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.797+0000 7f3f2887a640 1 -- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f24141820 msgr2=0x7f3f2413d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.797+0000 7f3f2887a640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f24141820 0x7f3f2413d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.797+0000 7f3f2887a640 1 -- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2413f330 msgr2=0x7f3f2413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.797+0000 7f3f2887a640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2413f330 0x7f3f2413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.797+0000 7f3f2887a640 1 -- 172.21.15.133:0/242721455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24155340 con 0x7f3f0c0039d0 2024-01-19T04:32:26.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.797+0000 7f3f2887a640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f241580b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f14000c10 tx=0x7f3f140190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:26.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.801+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140abd00 con 0x7f3f0c0039d0 2024-01-19T04:32:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.801+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f140abe60 con 0x7f3f0c0039d0 2024-01-19T04:32:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.801+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140b7670 con 0x7f3f0c0039d0 2024-01-19T04:32:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.801+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f24140b70 con 0x7f3f0c0039d0 2024-01-19T04:32:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.801+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f24142520 con 0x7f3f0c0039d0 2024-01-19T04:32:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.801+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f241409c0 con 0x7f3f0c0039d0 2024-01-19T04:32:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.821+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3f140b77d0 con 0x7f3f0c0039d0 2024-01-19T04:32:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.821+0000 7f3f217fa640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3f10066580 0x7f3f10068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:26.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.821+0000 7f3f23fff640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3f10066580 0x7f3f10068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:26.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:26.825+0000 7f3f23fff640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3f10066580 0x7f3f10068a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004880 tx=0x7f3f18001560 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:27.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.097+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f140eee60 con 0x7f3f0c0039d0 2024-01-19T04:32:27.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.097+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3f140eec30 con 0x7f3f0c0039d0 2024-01-19T04:32:27.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.281+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f24074340 con 0x7f3f0c0039d0 2024-01-19T04:32:27.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.357+0000 7f3f217fa640 1 -- 172.21.15.133:0/242721455 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f3f140be090 con 0x7f3f0c0039d0 2024-01-19T04:32:27.359 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:27.359 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:27.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3f10066580 msgr2=0x7f3f10068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:27.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3f10066580 0x7f3f10068a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004880 tx=0x7f3f18001560 comp rx=0 tx=0).stop 2024-01-19T04:32:27.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 msgr2=0x7f3f241580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:27.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f241580b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f14000c10 tx=0x7f3f140190a0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 shutdown_connections 2024-01-19T04:32:27.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3f10066580 0x7f3f10068a40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2413f330 0x7f3f2413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f24141820 0x7f3f2413d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 --2- 172.21.15.133:0/242721455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0039d0 0x7f3f241580b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 >> 172.21.15.133:0/242721455 conn(0x7f3f2406d590 msgr2=0x7f3f24071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 shutdown_connections 2024-01-19T04:32:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.361+0000 7f3f2aade640 1 -- 172.21.15.133:0/242721455 wait complete. 2024-01-19T04:32:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:31:30.230778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:31:31.446896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-19T04:31:37.539878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-19T04:32:27.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:32:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.513+0000 7fecd3003640 1 Processor -- start 2024-01-19T04:32:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.513+0000 7fecd3003640 1 -- start start 2024-01-19T04:32:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.513+0000 7fecd3003640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feccc0c7800 0x7feccc0c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.513+0000 7fecd3003640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc15a080 con 0x7feccc0c2f70 2024-01-19T04:32:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.513+0000 7fecd3003640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc159220 con 0x7feccc14fe10 2024-01-19T04:32:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.513+0000 7fecd3003640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc06bf00 con 0x7feccc0c7800 2024-01-19T04:32:27.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.525+0000 7feccbfff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feccc0c7800 0x7feccc0c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:27.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.525+0000 7feccbfff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feccc0c7800 0x7feccc0c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:38998/0 (socket says 172.21.15.133:38998) 2024-01-19T04:32:27.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.525+0000 7feccbfff640 1 -- 172.21.15.133:0/1381255808 learned_addr learned my addr 172.21.15.133:0/1381255808 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.533+0000 7feccbfff640 1 -- 172.21.15.133:0/1381255808 >> v1:172.21.15.156:6789/0 conn(0x7feccc14fe10 legacy=0x7feccc156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.533+0000 7feccbfff640 1 -- 172.21.15.133:0/1381255808 >> v1:172.21.15.133:6789/0 conn(0x7feccc0c2f70 legacy=0x7feccc0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.533+0000 7feccbfff640 1 -- 172.21.15.133:0/1381255808 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc159500 con 0x7feccc0c7800 2024-01-19T04:32:27.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.545+0000 7feccbfff640 1 --2- 172.21.15.133:0/1381255808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0c7800 0x7feccc0c2a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009870 tx=0x7fecc001ff20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7070be07b1d6803f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:27.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.661+0000 7feccb7fe640 1 -- 172.21.15.133:0/1381255808 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00a9d30 con 0x7feccc0c7800 2024-01-19T04:32:27.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.661+0000 7feccb7fe640 1 -- 172.21.15.133:0/1381255808 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc00a9e90 con 0x7feccc0c7800 2024-01-19T04:32:27.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.661+0000 7feccb7fe640 1 -- 172.21.15.133:0/1381255808 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00b1660 con 0x7feccc0c7800 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 -- 172.21.15.133:0/1381255808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0c7800 msgr2=0x7feccc0c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 --2- 172.21.15.133:0/1381255808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0c7800 0x7feccc0c2a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009870 tx=0x7fecc001ff20 comp rx=0 tx=0).stop 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 -- 172.21.15.133:0/1381255808 shutdown_connections 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 --2- 172.21.15.133:0/1381255808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc0c7800 0x7feccc0c2a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 -- 172.21.15.133:0/1381255808 >> 172.21.15.133:0/1381255808 conn(0x7feccc06fa20 msgr2=0x7feccc0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 -- 172.21.15.133:0/1381255808 shutdown_connections 2024-01-19T04:32:27.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 -- 172.21.15.133:0/1381255808 wait complete. 2024-01-19T04:32:27.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.665+0000 7fecd3003640 1 Processor -- start 2024-01-19T04:32:27.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 -- start start 2024-01-19T04:32:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feccc0c2f70 0x7feccc0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 0x7feccc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc14fe10 0x7feccc143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc1df7a0 con 0x7feccc0c2f70 2024-01-19T04:32:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc14f0e0 con 0x7feccc14fe10 2024-01-19T04:32:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd3003640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc14f660 con 0x7feccc0c7800 2024-01-19T04:32:27.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7feccbfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 0x7feccc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:27.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7fecd15a0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc14fe10 0x7feccc143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:27.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7feccbfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 0x7feccc06a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48138/0 (socket says 172.21.15.133:48138) 2024-01-19T04:32:27.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.669+0000 7feccbfff640 1 -- 172.21.15.133:0/700917865 learned_addr learned my addr 172.21.15.133:0/700917865 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:27.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.681+0000 7feccbfff640 1 -- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc14fe10 msgr2=0x7feccc143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:27.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.681+0000 7feccbfff640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc14fe10 0x7feccc143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.681+0000 7feccbfff640 1 -- 172.21.15.133:0/700917865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feccc0c2f70 msgr2=0x7feccc0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:27.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.681+0000 7feccbfff640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feccc0c2f70 0x7feccc0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:27.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.681+0000 7feccbfff640 1 -- 172.21.15.133:0/700917865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc00094d0 con 0x7feccc0c7800 2024-01-19T04:32:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.689+0000 7feccbfff640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 0x7feccc06a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecc001cb30 tx=0x7fecc001ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.697+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00b1e00 con 0x7feccc0c7800 2024-01-19T04:32:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.697+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc000c050 con 0x7feccc0c7800 2024-01-19T04:32:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.697+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00ba670 con 0x7feccc0c7800 2024-01-19T04:32:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.697+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc14f380 con 0x7feccc0c7800 2024-01-19T04:32:27.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.697+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc1df3c0 con 0x7feccc0c7800 2024-01-19T04:32:27.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.697+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc074340 con 0x7feccc0c7800 2024-01-19T04:32:27.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.749+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fecc00b8040 con 0x7feccc0c7800 2024-01-19T04:32:27.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.749+0000 7fecc97fa640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fecb8066550 0x7fecb8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:27.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.749+0000 7fecd0d9f640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fecb8066550 0x7fecb8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:27.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:27.753+0000 7fecd0d9f640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fecb8066550 0x7fecb8068a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fecbc000f70 tx=0x7fecbc0079c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:28.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.049+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecc00f3f40 con 0x7feccc0c7800 2024-01-19T04:32:28.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.077+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fecc00efb80 con 0x7feccc0c7800 2024-01-19T04:32:28.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.257+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feccc072aa0 con 0x7feccc0c7800 2024-01-19T04:32:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecc97fa640 1 -- 172.21.15.133:0/700917865 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fecc00f31a0 con 0x7feccc0c7800 2024-01-19T04:32:28.274 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fecb8066550 msgr2=0x7fecb8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fecb8066550 0x7fecb8068a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fecbc000f70 tx=0x7fecbc0079c0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 msgr2=0x7feccc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 0x7feccc06a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecc001cb30 tx=0x7fecc001ccc0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 shutdown_connections 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fecb8066550 0x7fecb8068a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feccc14fe10 0x7feccc143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feccc0c7800 0x7feccc06a8c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 --2- 172.21.15.133:0/700917865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feccc0c2f70 0x7feccc0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 >> 172.21.15.133:0/700917865 conn(0x7feccc06fa20 msgr2=0x7feccc0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 shutdown_connections 2024-01-19T04:32:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.273+0000 7fecd3003640 1 -- 172.21.15.133:0/700917865 wait complete. 2024-01-19T04:32:28.295 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:32:28.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 Processor -- start 2024-01-19T04:32:28.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 -- start start 2024-01-19T04:32:28.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea81516d0 0x7f8ea80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:28.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ea80cbde0 0x7f8ea80c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:28.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea80c65a0 con 0x7f8ea81512f0 2024-01-19T04:32:28.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea8158450 con 0x7f8ea81516d0 2024-01-19T04:32:28.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eb00b7640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea815ad60 con 0x7f8ea80cbde0 2024-01-19T04:32:28.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8ead652640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea81516d0 0x7f8ea80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:28.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8ead652640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea81516d0 0x7f8ea80c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58710/0 (socket says 172.21.15.133:58710) 2024-01-19T04:32:28.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8ead652640 1 -- 172.21.15.133:0/3930697807 learned_addr learned my addr 172.21.15.133:0/3930697807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:28.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.425+0000 7f8eae654640 1 --2- 172.21.15.133:0/3930697807 >> v2:172.21.15.156:3300/0 conn(0x7f8ea80cbde0 0x7f8ea80c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:28.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.429+0000 7f8ead652640 1 -- 172.21.15.133:0/3930697807 >> v2:172.21.15.156:3300/0 conn(0x7f8ea80cbde0 msgr2=0x7f8ea80c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:28.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.429+0000 7f8ead652640 1 --2- 172.21.15.133:0/3930697807 >> v2:172.21.15.156:3300/0 conn(0x7f8ea80cbde0 0x7f8ea80c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.429+0000 7f8ead652640 1 -- 172.21.15.133:0/3930697807 >> v1:172.21.15.156:6789/0 conn(0x7f8ea81512f0 legacy=0x7f8ea815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:28.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.429+0000 7f8ead652640 1 -- 172.21.15.133:0/3930697807 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8157650 con 0x7f8ea81516d0 2024-01-19T04:32:28.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.433+0000 7f8ead652640 1 --2- 172.21.15.133:0/3930697807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea80c52b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b1ec0 tx=0x7f8e9801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca5e333cb39c5ab server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:28.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eace51640 1 -- 172.21.15.133:0/3930697807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980a89b0 con 0x7f8ea81516d0 2024-01-19T04:32:28.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eace51640 1 -- 172.21.15.133:0/3930697807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e980a8b10 con 0x7f8ea81516d0 2024-01-19T04:32:28.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eace51640 1 -- 172.21.15.133:0/3930697807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980a8ea0 con 0x7f8ea81516d0 2024-01-19T04:32:28.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 -- 172.21.15.133:0/3930697807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 msgr2=0x7f8ea80c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/3930697807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea80c52b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b1ec0 tx=0x7f8e9801ecb0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 -- 172.21.15.133:0/3930697807 shutdown_connections 2024-01-19T04:32:28.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/3930697807 >> v2:172.21.15.156:3300/0 conn(0x7f8ea80cbde0 0x7f8ea80c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/3930697807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea80c52b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 -- 172.21.15.133:0/3930697807 >> 172.21.15.133:0/3930697807 conn(0x7f8ea8072890 msgr2=0x7f8ea806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:28.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.437+0000 7f8eb00b7640 1 -- 172.21.15.133:0/3930697807 shutdown_connections 2024-01-19T04:32:28.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 -- 172.21.15.133:0/3930697807 wait complete. 2024-01-19T04:32:28.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 Processor -- start 2024-01-19T04:32:28.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 -- start start 2024-01-19T04:32:28.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ea80cbde0 0x7f8ea8159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:28.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ea81512f0 0x7f8ea80c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:28.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea8156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:28.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea814e470 con 0x7f8ea81516d0 2024-01-19T04:32:28.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80c5080 con 0x7f8ea80cbde0 2024-01-19T04:32:28.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eb00b7640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80b0da0 con 0x7f8ea81512f0 2024-01-19T04:32:28.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eae654640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea8156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:28.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eae654640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea8156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58720/0 (socket says 172.21.15.133:58720) 2024-01-19T04:32:28.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.441+0000 7f8eae654640 1 -- 172.21.15.133:0/710969607 learned_addr learned my addr 172.21.15.133:0/710969607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:28.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8eade53640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ea80cbde0 0x7f8ea8159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:28.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8ead652640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ea81512f0 0x7f8ea80c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8eae654640 1 -- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ea81512f0 msgr2=0x7f8ea80c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8eae654640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ea81512f0 0x7f8ea80c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8eae654640 1 -- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ea80cbde0 msgr2=0x7f8ea8159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8eae654640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ea80cbde0 0x7f8ea8159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.445+0000 7f8eae654640 1 -- 172.21.15.133:0/710969607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980094d0 con 0x7f8ea81516d0 2024-01-19T04:32:28.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.449+0000 7f8eae654640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea8156b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0007e60 tx=0x7f8ea000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.453+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0014420 con 0x7f8ea81516d0 2024-01-19T04:32:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.453+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea00145a0 con 0x7f8ea81516d0 2024-01-19T04:32:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.453+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea80b1080 con 0x7f8ea81516d0 2024-01-19T04:32:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.453+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0014950 con 0x7f8ea81516d0 2024-01-19T04:32:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.453+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea80c3420 con 0x7f8ea81516d0 2024-01-19T04:32:28.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.453+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8074340 con 0x7f8ea81516d0 2024-01-19T04:32:28.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.477+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8ea0014ab0 con 0x7f8ea81516d0 2024-01-19T04:32:28.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.477+0000 7f8e9e7fc640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8e8c066580 0x7f8e8c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:28.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.477+0000 7f8eade53640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8e8c066580 0x7f8e8c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:28.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.477+0000 7f8eade53640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8e8c066580 0x7f8e8c068a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098e0 tx=0x7f8ea4009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:28.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.761+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ea0056520 con 0x7f8ea81516d0 2024-01-19T04:32:28.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.761+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8ea0052860 con 0x7f8ea81516d0 2024-01-19T04:32:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.937+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ea80cc490 con 0x7f8ea81516d0 2024-01-19T04:32:28.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8e9e7fc640 1 -- 172.21.15.133:0/710969607 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ea0055e80 con 0x7f8ea81516d0 2024-01-19T04:32:28.958 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:32:28.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8e8c066580 msgr2=0x7f8e8c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8e8c066580 0x7f8e8c068a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098e0 tx=0x7f8ea4009060 comp rx=0 tx=0).stop 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 msgr2=0x7f8ea8156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea8156b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0007e60 tx=0x7f8ea000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 shutdown_connections 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8e8c066580 0x7f8e8c068a40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea81516d0 0x7f8ea8156b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ea81512f0 0x7f8ea80c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 --2- 172.21.15.133:0/710969607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ea80cbde0 0x7f8ea8159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 >> 172.21.15.133:0/710969607 conn(0x7f8ea8072890 msgr2=0x7f8ea80c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.957+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 shutdown_connections 2024-01-19T04:32:28.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:28.961+0000 7f8eb00b7640 1 -- 172.21.15.133:0/710969607 wait complete. 2024-01-19T04:32:28.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:32:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 Processor -- start 2024-01-19T04:32:29.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 -- start start 2024-01-19T04:32:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 0x7f18f80c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18f806e460 0x7f18f815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f8156a20 con 0x7f18f8150500 2024-01-19T04:32:29.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f8156d00 con 0x7f18f806e460 2024-01-19T04:32:29.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.101+0000 7f18fe77a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8156fe0 con 0x7f18f80c2e00 2024-01-19T04:32:29.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.113+0000 7f18f77fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 0x7f18f80c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.113+0000 7f18f77fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 0x7f18f80c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48158/0 (socket says 172.21.15.133:48158) 2024-01-19T04:32:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.113+0000 7f18f77fe640 1 -- 172.21.15.133:0/3716104096 learned_addr learned my addr 172.21.15.133:0/3716104096 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:29.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.117+0000 7f18f77fe640 1 -- 172.21.15.133:0/3716104096 >> v2:172.21.15.133:3300/0 conn(0x7f18f806e460 msgr2=0x7f18f815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:29.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.117+0000 7f18f77fe640 1 --2- 172.21.15.133:0/3716104096 >> v2:172.21.15.133:3300/0 conn(0x7f18f806e460 0x7f18f815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.117+0000 7f18f77fe640 1 -- 172.21.15.133:0/3716104096 >> v1:172.21.15.133:6789/0 conn(0x7f18f8150500 legacy=0x7f18f8156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:29.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.117+0000 7f18f77fe640 1 -- 172.21.15.133:0/3716104096 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f81599e0 con 0x7f18f80c2e00 2024-01-19T04:32:29.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.125+0000 7f18f77fe640 1 --2- 172.21.15.133:0/3716104096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 0x7f18f80c5f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18e000bb10 tx=0x7f18e00213c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3753745d32ac3794 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.241+0000 7f18f6ffd640 1 -- 172.21.15.133:0/3716104096 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00b1600 con 0x7f18f80c2e00 2024-01-19T04:32:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.241+0000 7f18f6ffd640 1 -- 172.21.15.133:0/3716104096 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00ad050 con 0x7f18f80c2e00 2024-01-19T04:32:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.241+0000 7f18f6ffd640 1 -- 172.21.15.133:0/3716104096 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00b1980 con 0x7f18f80c2e00 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 -- 172.21.15.133:0/3716104096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 msgr2=0x7f18f80c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 --2- 172.21.15.133:0/3716104096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 0x7f18f80c5f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18e000bb10 tx=0x7f18e00213c0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 -- 172.21.15.133:0/3716104096 shutdown_connections 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 --2- 172.21.15.133:0/3716104096 >> v2:172.21.15.133:3300/0 conn(0x7f18f806e460 0x7f18f815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 --2- 172.21.15.133:0/3716104096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f80c2e00 0x7f18f80c5f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 -- 172.21.15.133:0/3716104096 >> 172.21.15.133:0/3716104096 conn(0x7f18f806b770 msgr2=0x7f18f806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 -- 172.21.15.133:0/3716104096 shutdown_connections 2024-01-19T04:32:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 -- 172.21.15.133:0/3716104096 wait complete. 2024-01-19T04:32:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 Processor -- start 2024-01-19T04:32:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.245+0000 7f18fe77a640 1 -- start start 2024-01-19T04:32:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fe77a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f806e460 0x7f18f81ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fe77a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 0x7f18f80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fe77a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 0x7f18f8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fe77a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80aa6f0 con 0x7f18f806e460 2024-01-19T04:32:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fe77a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80b0e90 con 0x7f18f80c2e00 2024-01-19T04:32:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fe77a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80b0ab0 con 0x7f18f8150500 2024-01-19T04:32:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18f77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 0x7f18f80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fcd17640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 0x7f18f8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18f77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 0x7f18f80b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:39040/0 (socket says 172.21.15.133:39040) 2024-01-19T04:32:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18fcd17640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 0x7f18f8155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48174/0 (socket says 172.21.15.133:48174) 2024-01-19T04:32:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.249+0000 7f18f77fe640 1 -- 172.21.15.133:0/1650898753 learned_addr learned my addr 172.21.15.133:0/1650898753 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:29.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18f7fff640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f806e460 0x7f18f81ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18fcd17640 1 -- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 msgr2=0x7f18f80b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18fcd17640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 0x7f18f80b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18fcd17640 1 -- 172.21.15.133:0/1650898753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f806e460 msgr2=0x7f18f81ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18fcd17640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f806e460 0x7f18f81ef680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18fcd17640 1 -- 172.21.15.133:0/1650898753 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e000b770 con 0x7f18f8150500 2024-01-19T04:32:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.257+0000 7f18f77fe640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 0x7f18f80b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:32:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.265+0000 7f18fcd17640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 0x7f18f8155030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18f000bdf0 tx=0x7f18f000bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.269+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000ce70 con 0x7f18f8150500 2024-01-19T04:32:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.269+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0014440 con 0x7f18f8150500 2024-01-19T04:32:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.269+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00147f0 con 0x7f18f8150500 2024-01-19T04:32:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.269+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f81e1e00 con 0x7f18f8150500 2024-01-19T04:32:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.269+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f81e23c0 con 0x7f18f8150500 2024-01-19T04:32:29.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.273+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8074340 con 0x7f18f8150500 2024-01-19T04:32:29.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.605+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f18f0014950 con 0x7f18f8150500 2024-01-19T04:32:29.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.605+0000 7f18f4ff9640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f18d8066550 0x7f18d8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.605+0000 7f18f7fff640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f18d8066550 0x7f18d8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.609+0000 7f18f7fff640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f18d8066550 0x7f18d8068a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f18e800a790 tx=0x7f18e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:29.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.613+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18f00557c0 con 0x7f18f8150500 2024-01-19T04:32:29.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.641+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f18f0051b00 con 0x7f18f8150500 2024-01-19T04:32:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.809+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18f80c70c0 con 0x7f18f8150500 2024-01-19T04:32:29.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.817+0000 7f18f4ff9640 1 -- 172.21.15.133:0/1650898753 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18f00230a0 con 0x7f18f8150500 2024-01-19T04:32:29.819 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f18d8066550 msgr2=0x7f18d8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f18d8066550 0x7f18d8068a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f18e800a790 tx=0x7f18e8008040 comp rx=0 tx=0).stop 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 msgr2=0x7f18f8155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 0x7f18f8155030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18f000bdf0 tx=0x7f18f000bee0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 shutdown_connections 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f18d8066550 0x7f18d8068a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f80c2e00 0x7f18f80b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f8150500 0x7f18f8155030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 --2- 172.21.15.133:0/1650898753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f806e460 0x7f18f81ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 >> 172.21.15.133:0/1650898753 conn(0x7f18f806b770 msgr2=0x7f18f80c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 shutdown_connections 2024-01-19T04:32:29.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.821+0000 7f18fe77a640 1 -- 172.21.15.133:0/1650898753 wait complete. 2024-01-19T04:32:29.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-19T04:32:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 Processor -- start 2024-01-19T04:32:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 -- start start 2024-01-19T04:32:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f34d81536b0 0x7f34d80c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d8153a90 0x7f34d806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80c6a90 con 0x7f34d80c2bc0 2024-01-19T04:32:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80c1330 con 0x7f34d8153a90 2024-01-19T04:32:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34df940640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d806e000 con 0x7f34d81536b0 2024-01-19T04:32:29.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34dcedb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d8153a90 0x7f34d806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34dcedb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d8153a90 0x7f34d806ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58748/0 (socket says 172.21.15.133:58748) 2024-01-19T04:32:29.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34dcedb640 1 -- 172.21.15.133:0/746504618 learned_addr learned my addr 172.21.15.133:0/746504618 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:29.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.969+0000 7f34dd6dc640 1 --2- 172.21.15.133:0/746504618 >> v2:172.21.15.156:3300/0 conn(0x7f34d81536b0 0x7f34d80c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.973+0000 7f34dcedb640 1 -- 172.21.15.133:0/746504618 >> v2:172.21.15.156:3300/0 conn(0x7f34d81536b0 msgr2=0x7f34d80c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.973+0000 7f34dcedb640 1 --2- 172.21.15.133:0/746504618 >> v2:172.21.15.156:3300/0 conn(0x7f34d81536b0 0x7f34d80c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.973+0000 7f34dcedb640 1 -- 172.21.15.133:0/746504618 >> v1:172.21.15.156:6789/0 conn(0x7f34d80c2bc0 legacy=0x7f34d80c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.973+0000 7f34dcedb640 1 -- 172.21.15.133:0/746504618 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d806e2e0 con 0x7f34d8153a90 2024-01-19T04:32:29.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.977+0000 7f34dcedb640 1 --2- 172.21.15.133:0/746504618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153a90 0x7f34d806ebe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34d80717f0 tx=0x7f34c801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15f689b381ee4a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:29.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34cffff640 1 -- 172.21.15.133:0/746504618 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80a89b0 con 0x7f34d8153a90 2024-01-19T04:32:29.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34cffff640 1 -- 172.21.15.133:0/746504618 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c80a8b10 con 0x7f34d8153a90 2024-01-19T04:32:29.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34cffff640 1 -- 172.21.15.133:0/746504618 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80a8ea0 con 0x7f34d8153a90 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 -- 172.21.15.133:0/746504618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153a90 msgr2=0x7f34d806ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 --2- 172.21.15.133:0/746504618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153a90 0x7f34d806ebe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34d80717f0 tx=0x7f34c801ecb0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 -- 172.21.15.133:0/746504618 shutdown_connections 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 --2- 172.21.15.133:0/746504618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153a90 0x7f34d806ebe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 --2- 172.21.15.133:0/746504618 >> v2:172.21.15.156:3300/0 conn(0x7f34d81536b0 0x7f34d80c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 -- 172.21.15.133:0/746504618 >> 172.21.15.133:0/746504618 conn(0x7f34d806b770 msgr2=0x7f34d806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 -- 172.21.15.133:0/746504618 shutdown_connections 2024-01-19T04:32:29.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 -- 172.21.15.133:0/746504618 wait complete. 2024-01-19T04:32:29.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 Processor -- start 2024-01-19T04:32:29.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.981+0000 7f34df940640 1 -- start start 2024-01-19T04:32:29.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34df940640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d80c2bc0 0x7f34d814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34df940640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 0x7f34d814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34df940640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d80cb9b0 0x7f34d80c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:29.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34df940640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814f860 con 0x7f34d81536b0 2024-01-19T04:32:29.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34df940640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814e8d0 con 0x7f34d80c2bc0 2024-01-19T04:32:29.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34df940640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814b330 con 0x7f34d80cb9b0 2024-01-19T04:32:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34dcedb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 0x7f34d814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34dcedb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 0x7f34d814adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58760/0 (socket says 172.21.15.133:58760) 2024-01-19T04:32:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34dcedb640 1 -- 172.21.15.133:0/3111671565 learned_addr learned my addr 172.21.15.133:0/3111671565 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34ddedd640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d80cb9b0 0x7f34d80c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.985+0000 7f34dd6dc640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d80c2bc0 0x7f34d814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:29.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34dcedb640 1 -- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d80cb9b0 msgr2=0x7f34d80c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34dcedb640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d80cb9b0 0x7f34d80c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34dcedb640 1 -- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d80c2bc0 msgr2=0x7f34d814f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:29.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34dcedb640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d80c2bc0 0x7f34d814f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:29.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34dcedb640 1 -- 172.21.15.133:0/3111671565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80094d0 con 0x7f34d81536b0 2024-01-19T04:32:29.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34ddedd640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d80cb9b0 0x7f34d80c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:32:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.989+0000 7f34dcedb640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 0x7f34d814adf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f34c80b3040 tx=0x7f34c801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:29.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.993+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80b0e80 con 0x7f34d81536b0 2024-01-19T04:32:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.993+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c80bb480 con 0x7f34d81536b0 2024-01-19T04:32:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.997+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80bb810 con 0x7f34d81536b0 2024-01-19T04:32:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.997+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d815aa20 con 0x7f34d81536b0 2024-01-19T04:32:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.997+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d81ef890 con 0x7f34d81536b0 2024-01-19T04:32:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:29.997+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d8074340 con 0x7f34d81536b0 2024-01-19T04:32:30.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.017+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f34c80bb970 con 0x7f34d81536b0 2024-01-19T04:32:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.017+0000 7f34cdffb640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34bc066550 0x7f34bc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.017+0000 7f34dd6dc640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34bc066550 0x7f34bc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:30.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.017+0000 7f34dd6dc640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34bc066550 0x7f34bc068a10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007a60 tx=0x7f34d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:30.263 INFO:tasks.ceph.mds.e.smithi133.stderr:2024-01-19T04:32:30.261+0000 f9d6640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-01-19T04:32:30.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.285+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34c80f46c0 con 0x7f34d81536b0 2024-01-19T04:32:30.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.285+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f34c80f0300 con 0x7f34d81536b0 2024-01-19T04:32:30.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.449+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f34d8074340 con 0x7f34d81536b0 2024-01-19T04:32:30.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.569+0000 7f34cdffb640 1 -- 172.21.15.133:0/3111671565 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f34c80b5020 con 0x7f34d81536b0 2024-01-19T04:32:30.570 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34bc066550 msgr2=0x7f34bc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34bc066550 0x7f34bc068a10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007a60 tx=0x7f34d4008040 comp rx=0 tx=0).stop 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 msgr2=0x7f34d814adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 0x7f34d814adf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f34c80b3040 tx=0x7f34c801ba50 comp rx=0 tx=0).stop 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 shutdown_connections 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34bc066550 0x7f34bc068a10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d80cb9b0 0x7f34d80c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d81536b0 0x7f34d814adf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 --2- 172.21.15.133:0/3111671565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d80c2bc0 0x7f34d814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 >> 172.21.15.133:0/3111671565 conn(0x7f34d806b770 msgr2=0x7f34d8073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 shutdown_connections 2024-01-19T04:32:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.573+0000 7f34df940640 1 -- 172.21.15.133:0/3111671565 wait complete. 2024-01-19T04:32:30.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:32:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.717+0000 7f2afffe9640 1 Processor -- start 2024-01-19T04:32:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.717+0000 7f2afffe9640 1 -- start start 2024-01-19T04:32:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afffe9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2af8151600 0x7f2af815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afffe9640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2af81519e0 0x7f2af80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afffe9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af8158390 con 0x7f2af806f350 2024-01-19T04:32:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afffe9640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af815b0e0 con 0x7f2af81519e0 2024-01-19T04:32:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afffe9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8157b70 con 0x7f2af8151600 2024-01-19T04:32:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afe586640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2af806f350 0x7f2af8157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32778/0 (socket says 172.21.15.133:32778) 2024-01-19T04:32:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.721+0000 7f2afe586640 1 -- 172.21.15.133:0/2355996481 learned_addr learned my addr 172.21.15.133:0/2355996481 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.725+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219439029 0 0) 0x7f2af8158390 con 0x7f2af806f350 2024-01-19T04:32:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.725+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae4003530 con 0x7f2af806f350 2024-01-19T04:32:30.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708232512 0 0) 0x7f2ae4003530 con 0x7f2af806f350 2024-01-19T04:32:30.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2af8151600 msgr2=0x7f2af815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:30.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2af8151600 0x7f2af815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 >> v2:172.21.15.156:3300/0 conn(0x7f2af81519e0 msgr2=0x7f2af80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 --2- 172.21.15.133:0/2355996481 >> v2:172.21.15.156:3300/0 conn(0x7f2af81519e0 0x7f2af80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8157dd0 con 0x7f2af806f350 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f2af0001a00 con 0x7f2af806f350 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 >> v1:172.21.15.133:6789/0 conn(0x7f2af806f350 legacy=0x7f2af8157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ae4003980 0x7f2ae4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2af8151600 0x7f2ae40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae4004d60 0x7f2ae40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af815b0e0 con 0x7f2ae4004d60 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8157b70 con 0x7f2ae4003980 2024-01-19T04:32:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae400bbf0 con 0x7f2af8151600 2024-01-19T04:32:30.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.729+0000 7f2afe586640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae4004d60 0x7f2ae40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.737+0000 7f2afe586640 1 -- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2af8151600 msgr2=0x7f2ae40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.737+0000 7f2afe586640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2af8151600 0x7f2ae40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.737+0000 7f2afe586640 1 -- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ae4003980 msgr2=0x7f2ae4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.737+0000 7f2afe586640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ae4003980 0x7f2ae4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.737+0000 7f2afe586640 1 -- 172.21.15.133:0/2355996481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4003530 con 0x7f2ae4004d60 2024-01-19T04:32:30.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.737+0000 7f2afe586640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae4004d60 0x7f2ae40051e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2af00013e0 tx=0x7f2af001d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffc45ebd6b77076 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:30.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00ad630 con 0x7f2ae4004d60 2024-01-19T04:32:30.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af00a8070 con 0x7f2ae4004d60 2024-01-19T04:32:30.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afcd83640 1 -- 172.21.15.133:0/2355996481 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00ada70 con 0x7f2ae4004d60 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 -- 172.21.15.133:0/2355996481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae4004d60 msgr2=0x7f2ae40051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 --2- 172.21.15.133:0/2355996481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae4004d60 0x7f2ae40051e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2af00013e0 tx=0x7f2af001d320 comp rx=0 tx=0).stop 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afe586640 1 -- 172.21.15.133:0/2355996481 reap_dead start 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 -- 172.21.15.133:0/2355996481 shutdown_connections 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 -- 172.21.15.133:0/2355996481 >> 172.21.15.133:0/2355996481 conn(0x7f2af806d590 msgr2=0x7f2af8066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 -- 172.21.15.133:0/2355996481 shutdown_connections 2024-01-19T04:32:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 -- 172.21.15.133:0/2355996481 wait complete. 2024-01-19T04:32:30.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.745+0000 7f2afffe9640 1 Processor -- start 2024-01-19T04:32:30.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 -- start start 2024-01-19T04:32:30.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ae4004d60 0x7f2af81429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 0x7f2af80714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2af80c1a50 0x7f2af8071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:30.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80c1190 con 0x7f2af8143c50 2024-01-19T04:32:30.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80c0450 con 0x7f2af80c1a50 2024-01-19T04:32:30.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afffe9640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af81f1f10 con 0x7f2ae4004d60 2024-01-19T04:32:30.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afd584640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 0x7f2af80714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:30.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afd584640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 0x7f2af80714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58778/0 (socket says 172.21.15.133:58778) 2024-01-19T04:32:30.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.749+0000 7f2afd584640 1 -- 172.21.15.133:0/1824402278 learned_addr learned my addr 172.21.15.133:0/1824402278 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.753+0000 7f2afd584640 1 -- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ae4004d60 msgr2=0x7f2af81429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.753+0000 7f2afd584640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ae4004d60 0x7f2af81429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.753+0000 7f2afd584640 1 -- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2af80c1a50 msgr2=0x7f2af8071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.753+0000 7f2afd584640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2af80c1a50 0x7f2af8071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:30.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.753+0000 7f2afd584640 1 -- 172.21.15.133:0/1824402278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af80c0170 con 0x7f2af8143c50 2024-01-19T04:32:30.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.753+0000 7f2afd584640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 0x7f2af80714c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800b430 tx=0x7f2ae800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:30.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.757+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011830 con 0x7f2af8143c50 2024-01-19T04:32:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.757+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae80119b0 con 0x7f2af8143c50 2024-01-19T04:32:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.761+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af8144b00 con 0x7f2af8143c50 2024-01-19T04:32:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.761+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8011d60 con 0x7f2af8143c50 2024-01-19T04:32:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.761+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af81450c0 con 0x7f2af8143c50 2024-01-19T04:32:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:30.761+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af8071fa0 con 0x7f2af8143c50 2024-01-19T04:32:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.037+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2ae801a400 con 0x7f2af8143c50 2024-01-19T04:32:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.037+0000 7f2aee7fc640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2adc066550 0x7f2adc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.037+0000 7f2afdd85640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2adc066550 0x7f2adc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.041+0000 7f2afdd85640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2adc066550 0x7f2adc068a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2af40096b0 tx=0x7f2af4006cb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:31.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.073+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ae8055be0 con 0x7f2af8143c50 2024-01-19T04:32:31.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.073+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2ae8051820 con 0x7f2af8143c50 2024-01-19T04:32:31.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.277+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2af8074340 con 0x7f2af8143c50 2024-01-19T04:32:31.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.313+0000 7f2aee7fc640 1 -- 172.21.15.133:0/1824402278 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6593 (secure 0 0 0) 0x7f2ae8015020 con 0x7f2af8143c50 2024-01-19T04:32:31.317 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:31.317 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:32:27.725491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4247,"mds_1":4238,"mds_2":4235,"mds_3":4224,"mds_4":4219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4219":{"gid":4219,"name":"d","rank":4,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4224":{"gid":4224,"name":"c","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"a","rank":1,"incarnation":11,"state":"up:active","state_seq":17,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:32:31.317 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2adc066550 msgr2=0x7f2adc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2adc066550 0x7f2adc068a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2af40096b0 tx=0x7f2af4006cb0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 msgr2=0x7f2af80714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 0x7f2af80714c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800b430 tx=0x7f2ae800b8f0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 shutdown_connections 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2adc066550 0x7f2adc068a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2af80c1a50 0x7f2af8071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2af8143c50 0x7f2af80714c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 --2- 172.21.15.133:0/1824402278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ae4004d60 0x7f2af81429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 >> 172.21.15.133:0/1824402278 conn(0x7f2af806d590 msgr2=0x7f2af80c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.317+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 shutdown_connections 2024-01-19T04:32:31.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.321+0000 7f2afffe9640 1 -- 172.21.15.133:0/1824402278 wait complete. 2024-01-19T04:32:31.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.465+0000 7f294a4d8640 1 Processor -- start 2024-01-19T04:32:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.465+0000 7f294a4d8640 1 -- start start 2024-01-19T04:32:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.469+0000 7f294a4d8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f294406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.469+0000 7f294a4d8640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2944070660 0x7f29440723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.469+0000 7f294a4d8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2944072920 0x7f29440c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.469+0000 7f294a4d8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2944070a80 con 0x7f2944072920 2024-01-19T04:32:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.469+0000 7f294a4d8640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294406ac50 con 0x7f2944070660 2024-01-19T04:32:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.469+0000 7f294a4d8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29441577f0 con 0x7f2944151720 2024-01-19T04:32:31.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.525+0000 7f2948a75640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2944072920 0x7f29440c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.525+0000 7f2943fff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f294406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.525+0000 7f2948a75640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2944072920 0x7f29440c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58780/0 (socket says 172.21.15.133:58780) 2024-01-19T04:32:31.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.525+0000 7f2948a75640 1 -- 172.21.15.133:0/1397736374 learned_addr learned my addr 172.21.15.133:0/1397736374 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.533+0000 7f2948a75640 1 -- 172.21.15.133:0/1397736374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 msgr2=0x7f294406a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.533+0000 7f2948a75640 1 --2- 172.21.15.133:0/1397736374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f294406a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.533+0000 7f2948a75640 1 -- 172.21.15.133:0/1397736374 >> v2:172.21.15.156:3300/0 conn(0x7f2944070660 msgr2=0x7f29440723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.533+0000 7f2948a75640 1 --2- 172.21.15.133:0/1397736374 >> v2:172.21.15.156:3300/0 conn(0x7f2944070660 0x7f29440723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.533+0000 7f2948a75640 1 -- 172.21.15.133:0/1397736374 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944157ad0 con 0x7f2944072920 2024-01-19T04:32:31.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.537+0000 7f2948a75640 1 --2- 172.21.15.133:0/1397736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c7ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29440c9940 tx=0x7f293c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8d73f077395f13 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:31.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f2942ffd640 1 -- 172.21.15.133:0/1397736374 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0a5820 con 0x7f2944072920 2024-01-19T04:32:31.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f2942ffd640 1 -- 172.21.15.133:0/1397736374 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0a5980 con 0x7f2944072920 2024-01-19T04:32:31.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f2942ffd640 1 -- 172.21.15.133:0/1397736374 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0a5d10 con 0x7f2944072920 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 -- 172.21.15.133:0/1397736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 msgr2=0x7f29440c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 --2- 172.21.15.133:0/1397736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c7ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29440c9940 tx=0x7f293c01c9a0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 -- 172.21.15.133:0/1397736374 shutdown_connections 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 --2- 172.21.15.133:0/1397736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c7ba0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 --2- 172.21.15.133:0/1397736374 >> v2:172.21.15.156:3300/0 conn(0x7f2944070660 0x7f29440723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 --2- 172.21.15.133:0/1397736374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f294406a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 -- 172.21.15.133:0/1397736374 >> 172.21.15.133:0/1397736374 conn(0x7f294406de30 msgr2=0x7f294406e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 -- 172.21.15.133:0/1397736374 shutdown_connections 2024-01-19T04:32:31.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.553+0000 7f294a4d8640 1 -- 172.21.15.133:0/1397736374 wait complete. 2024-01-19T04:32:31.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 Processor -- start 2024-01-19T04:32:31.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 -- start start 2024-01-19T04:32:31.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2944070660 0x7f29440c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f29441469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440cc5c0 con 0x7f2944072920 2024-01-19T04:32:31.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440c51a0 con 0x7f2944070660 2024-01-19T04:32:31.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f294a4d8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2944148780 con 0x7f2944151720 2024-01-19T04:32:31.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f2948a75640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f29441469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f2943fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2944070660 0x7f29440c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f2948a75640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f29441469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:48232/0 (socket says 172.21.15.133:48232) 2024-01-19T04:32:31.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f2943fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2944070660 0x7f29440c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:39130/0 (socket says 172.21.15.133:39130) 2024-01-19T04:32:31.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.557+0000 7f2948a75640 1 -- 172.21.15.133:0/2046920209 learned_addr learned my addr 172.21.15.133:0/2046920209 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:31.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.561+0000 7f29437fe640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.565+0000 7f2948a75640 1 -- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2944070660 msgr2=0x7f29440c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:31.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.565+0000 7f2948a75640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2944070660 0x7f29440c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.565+0000 7f2948a75640 1 -- 172.21.15.133:0/2046920209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 msgr2=0x7f29440c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:31.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.565+0000 7f2948a75640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:31.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.565+0000 7f2948a75640 1 -- 172.21.15.133:0/2046920209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c009b30 con 0x7f2944151720 2024-01-19T04:32:31.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.569+0000 7f2948a75640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f29441469e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f293c0af040 tx=0x7f293c019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:31.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.577+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0b8670 con 0x7f2944151720 2024-01-19T04:32:31.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.577+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0b87d0 con 0x7f2944151720 2024-01-19T04:32:31.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.577+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0b8b80 con 0x7f2944151720 2024-01-19T04:32:31.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.577+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29441e8b40 con 0x7f2944151720 2024-01-19T04:32:31.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.581+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29441e8d90 con 0x7f2944151720 2024-01-19T04:32:31.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.581+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2944074340 con 0x7f2944151720 2024-01-19T04:32:31.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.905+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f293c0b8ce0 con 0x7f2944151720 2024-01-19T04:32:31.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.909+0000 7f2940ff9640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2924066550 0x7f2924068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:31.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.909+0000 7f2943fff640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2924066550 0x7f2924068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:31.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.909+0000 7f2943fff640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2924066550 0x7f2924068a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2934009ac0 tx=0x7f2934009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:31.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.913+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f293c0f0f20 con 0x7f2944151720 2024-01-19T04:32:31.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:31.937+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f293c0ed260 con 0x7f2944151720 2024-01-19T04:32:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.121+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29441505c0 con 0x7f2944151720 2024-01-19T04:32:32.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f2940ff9640 1 -- 172.21.15.133:0/2046920209 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18395 (secure 0 0 0) 0x7f293c0f0880 con 0x7f2944151720 2024-01-19T04:32:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:32.233 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:31:40.951124+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:32.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2924066550 msgr2=0x7f2924068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2924066550 0x7f2924068a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2934009ac0 tx=0x7f2934009190 comp rx=0 tx=0).stop 2024-01-19T04:32:32.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 msgr2=0x7f29441469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f29441469e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f293c0af040 tx=0x7f293c019740 comp rx=0 tx=0).stop 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 shutdown_connections 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2924066550 0x7f2924068a10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2944151720 0x7f29441469e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2944072920 0x7f29440c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 --2- 172.21.15.133:0/2046920209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2944070660 0x7f29440c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 >> 172.21.15.133:0/2046920209 conn(0x7f294406de30 msgr2=0x7f294406e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 shutdown_connections 2024-01-19T04:32:32.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.233+0000 7f294a4d8640 1 -- 172.21.15.133:0/2046920209 wait complete. 2024-01-19T04:32:32.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:31:30.230778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:31:31.446896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-19T04:31:37.539878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-19T04:32:32.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:32:32.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.385+0000 7fda8f211640 1 Processor -- start 2024-01-19T04:32:32.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.385+0000 7fda8f211640 1 -- start start 2024-01-19T04:32:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8f211640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda880c9920 0x7fda880c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8f211640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda8815a600 0x7fda8815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8f211640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8815a170 con 0x7fda880cf9e0 2024-01-19T04:32:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8f211640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda88159950 con 0x7fda880c9920 2024-01-19T04:32:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8f211640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda880c9420 con 0x7fda8815a600 2024-01-19T04:32:32.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8cfad640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda880c9920 0x7fda880c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:32.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8cfad640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda880c9920 0x7fda880c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50128/0 (socket says 172.21.15.133:50128) 2024-01-19T04:32:32.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.389+0000 7fda8cfad640 1 -- 172.21.15.133:0/1636509947 learned_addr learned my addr 172.21.15.133:0/1636509947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.393+0000 7fda8cfad640 1 -- 172.21.15.133:0/1636509947 >> v2:172.21.15.156:3300/0 conn(0x7fda8815a600 msgr2=0x7fda8815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.393+0000 7fda8cfad640 1 --2- 172.21.15.133:0/1636509947 >> v2:172.21.15.156:3300/0 conn(0x7fda8815a600 0x7fda8815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.393+0000 7fda8cfad640 1 -- 172.21.15.133:0/1636509947 >> v1:172.21.15.156:6789/0 conn(0x7fda880cf9e0 legacy=0x7fda880b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.393+0000 7fda8cfad640 1 -- 172.21.15.133:0/1636509947 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8815d420 con 0x7fda880c9920 2024-01-19T04:32:32.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.393+0000 7fda8cfad640 1 --2- 172.21.15.133:0/1636509947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c9d00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fda880ccdb0 tx=0x7fda7801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81da83025a6ddb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.397+0000 7fda877fe640 1 -- 172.21.15.133:0/1636509947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780a89b0 con 0x7fda880c9920 2024-01-19T04:32:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.397+0000 7fda877fe640 1 -- 172.21.15.133:0/1636509947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda780a8b10 con 0x7fda880c9920 2024-01-19T04:32:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.397+0000 7fda877fe640 1 -- 172.21.15.133:0/1636509947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780a8ea0 con 0x7fda880c9920 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- 172.21.15.133:0/1636509947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 msgr2=0x7fda880c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 --2- 172.21.15.133:0/1636509947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c9d00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fda880ccdb0 tx=0x7fda7801ecb0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- 172.21.15.133:0/1636509947 shutdown_connections 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 --2- 172.21.15.133:0/1636509947 >> v2:172.21.15.156:3300/0 conn(0x7fda8815a600 0x7fda8815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 --2- 172.21.15.133:0/1636509947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c9d00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- 172.21.15.133:0/1636509947 >> 172.21.15.133:0/1636509947 conn(0x7fda8808afa0 msgr2=0x7fda8808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- 172.21.15.133:0/1636509947 shutdown_connections 2024-01-19T04:32:32.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- 172.21.15.133:0/1636509947 wait complete. 2024-01-19T04:32:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 Processor -- start 2024-01-19T04:32:32.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- start start 2024-01-19T04:32:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda880cf9e0 0x7fda881542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda8815a600 0x7fda88157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda880c7830 con 0x7fda880c9920 2024-01-19T04:32:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda88158840 con 0x7fda880cf9e0 2024-01-19T04:32:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8f211640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda881e3190 con 0x7fda8815a600 2024-01-19T04:32:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8cfad640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8cfad640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50130/0 (socket says 172.21.15.133:50130) 2024-01-19T04:32:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.401+0000 7fda8cfad640 1 -- 172.21.15.133:0/285729353 learned_addr learned my addr 172.21.15.133:0/285729353 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.405+0000 7fda8d7ae640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda8815a600 0x7fda88157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.405+0000 7fda8cfad640 1 -- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda8815a600 msgr2=0x7fda88157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.405+0000 7fda8cfad640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda8815a600 0x7fda88157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.405+0000 7fda8cfad640 1 -- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda880cf9e0 msgr2=0x7fda881542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.405+0000 7fda8cfad640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda880cf9e0 0x7fda881542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.405+0000 7fda8cfad640 1 -- 172.21.15.133:0/285729353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780094d0 con 0x7fda880c9920 2024-01-19T04:32:32.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.409+0000 7fda8cfad640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c7cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda7801b8c0 tx=0x7fda7801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:32.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.429+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780b1d90 con 0x7fda880c9920 2024-01-19T04:32:32.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.429+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda881e2eb0 con 0x7fda880c9920 2024-01-19T04:32:32.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.429+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda880c74c0 con 0x7fda880c9920 2024-01-19T04:32:32.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.433+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8806d7f0 con 0x7fda880c9920 2024-01-19T04:32:32.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.729+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda780bb470 con 0x7fda880c9920 2024-01-19T04:32:32.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.729+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780bb7e0 con 0x7fda880c9920 2024-01-19T04:32:32.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.729+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fda780b7070 con 0x7fda880c9920 2024-01-19T04:32:32.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.733+0000 7fda857fa640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fda6c066500 0x7fda6c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.733+0000 7fda87fff640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fda6c066500 0x7fda6c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:32.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.733+0000 7fda87fff640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fda6c066500 0x7fda6c0689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda88156ee0 tx=0x7fda80009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:32.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.773+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda780f42c0 con 0x7fda880c9920 2024-01-19T04:32:32.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.777+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fda780eff00 con 0x7fda880c9920 2024-01-19T04:32:32.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.961+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda8806d7f0 con 0x7fda880c9920 2024-01-19T04:32:32.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.981+0000 7fda857fa640 1 -- 172.21.15.133:0/285729353 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda780b5070 con 0x7fda880c9920 2024-01-19T04:32:32.983 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fda6c066500 msgr2=0x7fda6c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fda6c066500 0x7fda6c0689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda88156ee0 tx=0x7fda80009250 comp rx=0 tx=0).stop 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 msgr2=0x7fda880c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c7cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fda7801b8c0 tx=0x7fda7801ba50 comp rx=0 tx=0).stop 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 shutdown_connections 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fda6c066500 0x7fda6c0689c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda880cf9e0 0x7fda881542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda8815a600 0x7fda88157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 --2- 172.21.15.133:0/285729353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda880c9920 0x7fda880c7cc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:32.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 >> 172.21.15.133:0/285729353 conn(0x7fda8808afa0 msgr2=0x7fda880cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:32.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 shutdown_connections 2024-01-19T04:32:32.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:32.985+0000 7fda8f211640 1 -- 172.21.15.133:0/285729353 wait complete. 2024-01-19T04:32:33.004 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:32:33.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.125+0000 7f0fa0bdd640 1 Processor -- start 2024-01-19T04:32:33.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.125+0000 7f0fa0bdd640 1 -- start start 2024-01-19T04:32:33.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.125+0000 7f0fa0bdd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 0x7f0f9c157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.125+0000 7f0fa0bdd640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0c7500 con 0x7f0f9c0c5db0 2024-01-19T04:32:33.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.125+0000 7f0fa0bdd640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c151b20 con 0x7f0f9c0c7990 2024-01-19T04:32:33.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.125+0000 7f0fa0bdd640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c06f190 con 0x7f0f9c151740 2024-01-19T04:32:33.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.129+0000 7f0f99d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0f9c0c5db0 0x7f0f9c06ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33888/0 (socket says 172.21.15.133:33888) 2024-01-19T04:32:33.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.129+0000 7f0f99d9b640 1 -- 172.21.15.133:0/3138373898 learned_addr learned my addr 172.21.15.133:0/3138373898 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:33.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.129+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 0x7f0f9c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.129+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213620616 0 0) 0x7f0f9c0c7500 con 0x7f0f9c0c5db0 2024-01-19T04:32:33.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.129+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f84003530 con 0x7f0f9c0c5db0 2024-01-19T04:32:33.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229978260 0 0) 0x7f0f9c151b20 con 0x7f0f9c0c7990 2024-01-19T04:32:33.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c0c7500 con 0x7f0f9c0c7990 2024-01-19T04:32:33.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106462568 0 0) 0x7f0f84003530 con 0x7f0f9c0c5db0 2024-01-19T04:32:33.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 msgr2=0x7f0f9c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:33.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 0x7f0f9c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 >> v1:172.21.15.156:6789/0 conn(0x7f0f9c0c7990 legacy=0x7f0f9c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0c7e40 con 0x7f0f9c0c5db0 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f0f90001680 con 0x7f0f9c0c5db0 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 >> v1:172.21.15.133:6789/0 conn(0x7f0f9c0c5db0 legacy=0x7f0f9c06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f84003bb0 0x7f0f84003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 0x7f0f840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f84004d10 0x7f0f84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c06f190 con 0x7f0f84003bb0 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8400bac0 con 0x7f0f84004d10 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.133+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8400bc80 con 0x7f0f9c151740 2024-01-19T04:32:33.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.137+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f84003bb0 0x7f0f84003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.141+0000 7f0f9a59c640 1 -- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 msgr2=0x7f0f840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:33.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.141+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9c151740 0x7f0f840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.141+0000 7f0f9a59c640 1 -- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f84004d10 msgr2=0x7f0f84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:33.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.141+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f84004d10 0x7f0f84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.141+0000 7f0f9a59c640 1 -- 172.21.15.133:0/3138373898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84003530 con 0x7f0f84003bb0 2024-01-19T04:32:33.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.145+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f84003bb0 0x7f0f84003fb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009ae0 tx=0x7f0f9401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec75980c87046e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:33.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.149+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940a55c0 con 0x7f0f84003bb0 2024-01-19T04:32:33.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f940a5720 con 0x7f0f84003bb0 2024-01-19T04:32:33.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0f9959a640 1 -- 172.21.15.133:0/3138373898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940a5ad0 con 0x7f0f84003bb0 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/3138373898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f84003bb0 msgr2=0x7f0f84003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/3138373898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f84003bb0 0x7f0f84003fb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009ae0 tx=0x7f0f9401c9d0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0f9ad9d640 1 -- 172.21.15.133:0/3138373898 reap_dead start 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/3138373898 shutdown_connections 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/3138373898 >> 172.21.15.133:0/3138373898 conn(0x7f0f9c06b770 msgr2=0x7f0f9c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/3138373898 shutdown_connections 2024-01-19T04:32:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.153+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/3138373898 wait complete. 2024-01-19T04:32:33.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 Processor -- start 2024-01-19T04:32:33.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 -- start start 2024-01-19T04:32:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f84003bb0 0x7f0f9c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9c14b120 0x7f0f9c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 0x7f0f9c1e1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c1a00 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c1140 con 0x7f0f9c14b120 2024-01-19T04:32:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0fa0bdd640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c14a6d0 con 0x7f0f84003bb0 2024-01-19T04:32:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0f9ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 0x7f0f9c1e1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0f9ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 0x7f0f9c1e1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50146/0 (socket says 172.21.15.133:50146) 2024-01-19T04:32:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0f9ad9d640 1 -- 172.21.15.133:0/2790673218 learned_addr learned my addr 172.21.15.133:0/2790673218 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f84003bb0 0x7f0f9c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.157+0000 7f0f99d9b640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9c14b120 0x7f0f9c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.161+0000 7f0f9ad9d640 1 -- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f84003bb0 msgr2=0x7f0f9c14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.161+0000 7f0f9ad9d640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f84003bb0 0x7f0f9c14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.161+0000 7f0f9ad9d640 1 -- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9c14b120 msgr2=0x7f0f9c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.161+0000 7f0f9ad9d640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9c14b120 0x7f0f9c0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.161+0000 7f0f9ad9d640 1 -- 172.21.15.133:0/2790673218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0c13b0 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.165+0000 7f0f9ad9d640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 0x7f0f9c1e1810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0b1b70 tx=0x7f0f8c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.169+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c00d820 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.169+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c00d980 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.169+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c00dd30 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.169+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0c1690 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.169+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c149d60 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.169+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c0c1b70 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.189+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0f8c00a070 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.189+0000 7f0f8affd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0f7c066550 0x7f0f7c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.189+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0f7c066550 0x7f0f7c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.193+0000 7f0f9a59c640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0f7c066550 0x7f0f7c068a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f940af000 tx=0x7f0f940046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:33.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.461+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f8c057cc0 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.461+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0f8c054000 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.629+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f9c074340 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.677+0000 7f0f8affd640 1 -- 172.21.15.133:0/2790673218 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f8c057620 con 0x7f0f9c0c1e90 2024-01-19T04:32:33.679 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0f7c066550 msgr2=0x7f0f7c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0f7c066550 0x7f0f7c068a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f940af000 tx=0x7f0f940046d0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 msgr2=0x7f0f9c1e1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 0x7f0f9c1e1810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0b1b70 tx=0x7f0f8c00ff70 comp rx=0 tx=0).stop 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 shutdown_connections 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0f7c066550 0x7f0f7c068a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9c14b120 0x7f0f9c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f9c0c1e90 0x7f0f9c1e1810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 --2- 172.21.15.133:0/2790673218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f84003bb0 0x7f0f9c14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 >> 172.21.15.133:0/2790673218 conn(0x7f0f9c06b770 msgr2=0x7f0f9c157200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:33.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 shutdown_connections 2024-01-19T04:32:33.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.681+0000 7f0fa0bdd640 1 -- 172.21.15.133:0/2790673218 wait complete. 2024-01-19T04:32:33.703 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:32:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.825+0000 7f12bf7f0640 1 Processor -- start 2024-01-19T04:32:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.825+0000 7f12bf7f0640 1 -- start start 2024-01-19T04:32:33.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bf7f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12b80c8310 0x7f12b8151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bf7f0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b815a9d0 con 0x7f12b80c7f30 2024-01-19T04:32:33.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bf7f0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b81573e0 con 0x7f12b8071970 2024-01-19T04:32:33.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bf7f0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b806e1a0 con 0x7f12b80c8310 2024-01-19T04:32:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bcd8b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12b80c8310 0x7f12b8151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bd58c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f12b80c7f30 0x7f12b806da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33902/0 (socket says 172.21.15.133:33902) 2024-01-19T04:32:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.829+0000 7f12bd58c640 1 -- 172.21.15.133:0/540122807 learned_addr learned my addr 172.21.15.133:0/540122807 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.833+0000 7f12bcd8b640 1 -- 172.21.15.133:0/540122807 >> v1:172.21.15.156:6789/0 conn(0x7f12b8071970 legacy=0x7f12b815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.833+0000 7f12bcd8b640 1 -- 172.21.15.133:0/540122807 >> v1:172.21.15.133:6789/0 conn(0x7f12b80c7f30 legacy=0x7f12b806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.833+0000 7f12bcd8b640 1 -- 172.21.15.133:0/540122807 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b81576a0 con 0x7f12b80c8310 2024-01-19T04:32:33.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.841+0000 7f12bcd8b640 1 --2- 172.21.15.133:0/540122807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c8310 0x7f12b8151190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097c0 tx=0x7f12a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c743cc654b4dc5f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:33.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.845+0000 7f12affff640 1 -- 172.21.15.133:0/540122807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80a8970 con 0x7f12b80c8310 2024-01-19T04:32:33.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12affff640 1 -- 172.21.15.133:0/540122807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a80a8ad0 con 0x7f12b80c8310 2024-01-19T04:32:33.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12affff640 1 -- 172.21.15.133:0/540122807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80a8e60 con 0x7f12b80c8310 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 -- 172.21.15.133:0/540122807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c8310 msgr2=0x7f12b8151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/540122807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c8310 0x7f12b8151190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097c0 tx=0x7f12a801ec70 comp rx=0 tx=0).stop 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 -- 172.21.15.133:0/540122807 shutdown_connections 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/540122807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c8310 0x7f12b8151190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 -- 172.21.15.133:0/540122807 >> 172.21.15.133:0/540122807 conn(0x7f12b806aa60 msgr2=0x7f12b806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 -- 172.21.15.133:0/540122807 shutdown_connections 2024-01-19T04:32:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 -- 172.21.15.133:0/540122807 wait complete. 2024-01-19T04:32:33.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 Processor -- start 2024-01-19T04:32:33.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.849+0000 7f12bf7f0640 1 -- start start 2024-01-19T04:32:33.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bf7f0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12b8071970 0x7f12b8145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bf7f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 0x7f12b815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bf7f0640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12b80c8310 0x7f12b81f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bf7f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b814f710 con 0x7f12b80c7f30 2024-01-19T04:32:33.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bf7f0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80c2b30 con 0x7f12b8071970 2024-01-19T04:32:33.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bf7f0640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80c44f0 con 0x7f12b80c8310 2024-01-19T04:32:33.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bcd8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 0x7f12b815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bcd8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 0x7f12b815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50160/0 (socket says 172.21.15.133:50160) 2024-01-19T04:32:33.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bcd8b640 1 -- 172.21.15.133:0/3978246586 learned_addr learned my addr 172.21.15.133:0/3978246586 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:33.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bdd8d640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12b80c8310 0x7f12b81f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.853+0000 7f12bd58c640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12b8071970 0x7f12b8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.857+0000 7f12bcd8b640 1 -- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12b80c8310 msgr2=0x7f12b81f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.857+0000 7f12bcd8b640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12b80c8310 0x7f12b81f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.857+0000 7f12bcd8b640 1 -- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12b8071970 msgr2=0x7f12b8145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.857+0000 7f12bcd8b640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12b8071970 0x7f12b8145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.857+0000 7f12bcd8b640 1 -- 172.21.15.133:0/3978246586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009420 con 0x7f12b80c7f30 2024-01-19T04:32:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.857+0000 7f12bcd8b640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 0x7f12b815a010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12a80b3040 tx=0x7f12a801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:33.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.861+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80b9630 con 0x7f12b80c7f30 2024-01-19T04:32:33.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.861+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a80b97b0 con 0x7f12b80c7f30 2024-01-19T04:32:33.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.861+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80b9b60 con 0x7f12b80c7f30 2024-01-19T04:32:33.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.861+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b80c4a90 con 0x7f12b80c7f30 2024-01-19T04:32:33.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.861+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b80c2dd0 con 0x7f12b80c7f30 2024-01-19T04:32:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.865+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b8074340 con 0x7f12b80c7f30 2024-01-19T04:32:33.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.889+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f12a80b7040 con 0x7f12b80c7f30 2024-01-19T04:32:33.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.889+0000 7f12adffb640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f129c066580 0x7f129c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:33.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.889+0000 7f12bd58c640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f129c066580 0x7f129c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:33.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.889+0000 7f12bd58c640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f129c066580 0x7f129c068a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f12b4005890 tx=0x7f12b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:33.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:33.889+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12a80f38c0 con 0x7f12b80c7f30 2024-01-19T04:32:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.189+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f12a8120e60 con 0x7f12b80c7f30 2024-01-19T04:32:34.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.357+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12b806d090 con 0x7f12b80c7f30 2024-01-19T04:32:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12adffb640 1 -- 172.21.15.133:0/3978246586 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12a80b5020 con 0x7f12b80c7f30 2024-01-19T04:32:34.481 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-19T04:32:34.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f129c066580 msgr2=0x7f129c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:34.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f129c066580 0x7f129c068a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f12b4005890 tx=0x7f12b4009040 comp rx=0 tx=0).stop 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 msgr2=0x7f12b815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 0x7f12b815a010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12a80b3040 tx=0x7f12a801ba10 comp rx=0 tx=0).stop 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 shutdown_connections 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f129c066580 0x7f129c068a40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12b80c8310 0x7f12b81f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b80c7f30 0x7f12b815a010 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 --2- 172.21.15.133:0/3978246586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12b8071970 0x7f12b8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 >> 172.21.15.133:0/3978246586 conn(0x7f12b806aa60 msgr2=0x7f12b80c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 shutdown_connections 2024-01-19T04:32:34.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.377+0000 7f12bf7f0640 1 -- 172.21.15.133:0/3978246586 wait complete. 2024-01-19T04:32:34.484 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-19T04:32:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.613+0000 7fbb273a2640 1 Processor -- start 2024-01-19T04:32:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.613+0000 7fbb273a2640 1 -- start start 2024-01-19T04:32:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.617+0000 7fbb273a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb201507a0 0x7fbb200c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.617+0000 7fbb273a2640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb200c5580 0x7fbb200c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.617+0000 7fbb273a2640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200c7c10 con 0x7fbb200c51a0 2024-01-19T04:32:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.617+0000 7fbb273a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb20159850 con 0x7fbb201507a0 2024-01-19T04:32:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.617+0000 7fbb273a2640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb20159b30 con 0x7fbb200c5580 2024-01-19T04:32:34.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.625+0000 7fbb2593f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb200c5580 0x7fbb200c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:34.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.625+0000 7fbb2593f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb200c5580 0x7fbb200c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:41704/0 (socket says 172.21.15.133:41704) 2024-01-19T04:32:34.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.625+0000 7fbb2593f640 1 -- 172.21.15.133:0/378359169 learned_addr learned my addr 172.21.15.133:0/378359169 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.633+0000 7fbb2593f640 1 -- 172.21.15.133:0/378359169 >> v2:172.21.15.133:3300/0 conn(0x7fbb201507a0 msgr2=0x7fbb200c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:34.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.633+0000 7fbb2593f640 1 --2- 172.21.15.133:0/378359169 >> v2:172.21.15.133:3300/0 conn(0x7fbb201507a0 0x7fbb200c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.633+0000 7fbb2593f640 1 -- 172.21.15.133:0/378359169 >> v1:172.21.15.156:6789/0 conn(0x7fbb200c51a0 legacy=0x7fbb20150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:34.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.633+0000 7fbb2593f640 1 -- 172.21.15.133:0/378359169 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20159e10 con 0x7fbb200c5580 2024-01-19T04:32:34.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.645+0000 7fbb2593f640 1 --2- 172.21.15.133:0/378359169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb200c5580 0x7fbb200c2b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb200c2790 tx=0x7fbb1801ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35d1146f8c3eae server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.653+0000 7fbb17fff640 1 -- 172.21.15.133:0/378359169 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180a89f0 con 0x7fbb200c5580 2024-01-19T04:32:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.653+0000 7fbb17fff640 1 -- 172.21.15.133:0/378359169 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb180a8b50 con 0x7fbb200c5580 2024-01-19T04:32:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.653+0000 7fbb17fff640 1 -- 172.21.15.133:0/378359169 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180b0440 con 0x7fbb200c5580 2024-01-19T04:32:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 -- 172.21.15.133:0/378359169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb200c5580 msgr2=0x7fbb200c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 --2- 172.21.15.133:0/378359169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb200c5580 0x7fbb200c2b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb200c2790 tx=0x7fbb1801ecf0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 -- 172.21.15.133:0/378359169 shutdown_connections 2024-01-19T04:32:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 --2- 172.21.15.133:0/378359169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb200c5580 0x7fbb200c2b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 --2- 172.21.15.133:0/378359169 >> v2:172.21.15.133:3300/0 conn(0x7fbb201507a0 0x7fbb200c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 -- 172.21.15.133:0/378359169 >> 172.21.15.133:0/378359169 conn(0x7fbb200cb3e0 msgr2=0x7fbb200cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:34.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 -- 172.21.15.133:0/378359169 shutdown_connections 2024-01-19T04:32:34.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 -- 172.21.15.133:0/378359169 wait complete. 2024-01-19T04:32:34.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 Processor -- start 2024-01-19T04:32:34.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.657+0000 7fbb273a2640 1 -- start start 2024-01-19T04:32:34.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb273a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200c51a0 0x7fbb201f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:34.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb273a2640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb200c5580 0x7fbb201ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:34.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb273a2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 0x7fbb2006b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:34.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb273a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb201eeca0 con 0x7fbb200c51a0 2024-01-19T04:32:34.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb273a2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb201ef200 con 0x7fbb201507a0 2024-01-19T04:32:34.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb273a2640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb201efbd0 con 0x7fbb200c5580 2024-01-19T04:32:34.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb2593f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 0x7fbb2006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:34.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb2493d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb200c5580 0x7fbb201ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:34.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb2593f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 0x7fbb2006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:41714/0 (socket says 172.21.15.133:41714) 2024-01-19T04:32:34.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.661+0000 7fbb2593f640 1 -- 172.21.15.133:0/4240895462 learned_addr learned my addr 172.21.15.133:0/4240895462 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:34.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.673+0000 7fbb2493d640 1 -- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 msgr2=0x7fbb2006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:34.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.673+0000 7fbb2493d640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 0x7fbb2006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.673+0000 7fbb2493d640 1 -- 172.21.15.133:0/4240895462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200c51a0 msgr2=0x7fbb201f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:34.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.673+0000 7fbb2493d640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200c51a0 0x7fbb201f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:34.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.673+0000 7fbb2493d640 1 -- 172.21.15.133:0/4240895462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180094d0 con 0x7fbb200c5580 2024-01-19T04:32:34.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.673+0000 7fbb2593f640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 0x7fbb2006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:32:34.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.677+0000 7fbb2493d640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb200c5580 0x7fbb201ef690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000b3e0 tx=0x7fbb1000b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:34.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.689+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10011830 con 0x7fbb200c5580 2024-01-19T04:32:34.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.689+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100119b0 con 0x7fbb200c5580 2024-01-19T04:32:34.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.689+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10011d60 con 0x7fbb200c5580 2024-01-19T04:32:34.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.689+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb20144be0 con 0x7fbb200c5580 2024-01-19T04:32:34.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.689+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb201eee90 con 0x7fbb200c5580 2024-01-19T04:32:34.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.693+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb20145100 con 0x7fbb200c5580 2024-01-19T04:32:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.745+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbb1001a400 con 0x7fbb200c5580 2024-01-19T04:32:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.745+0000 7fbb15ffb640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbb04066550 0x7fbb04068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.745+0000 7fbb2513e640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbb04066550 0x7fbb04068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:34.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:34.745+0000 7fbb2513e640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbb04066550 0x7fbb04068a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c007fd0 tx=0x7fbb1c007d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:35.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.037+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb10055b70 con 0x7fbb200c5580 2024-01-19T04:32:35.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.053+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbb100517b0 con 0x7fbb200c5580 2024-01-19T04:32:35.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.225+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbb20074340 con 0x7fbb200c5580 2024-01-19T04:32:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.241+0000 7fbb15ffb640 1 -- 172.21.15.133:0/4240895462 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbb10015020 con 0x7fbb200c5580 2024-01-19T04:32:35.243 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbb04066550 msgr2=0x7fbb04068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbb04066550 0x7fbb04068a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c007fd0 tx=0x7fbb1c007d40 comp rx=0 tx=0).stop 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb200c5580 msgr2=0x7fbb201ef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb200c5580 0x7fbb201ef690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000b3e0 tx=0x7fbb1000b7e0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 shutdown_connections 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fbb04066550 0x7fbb04068a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb201507a0 0x7fbb2006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb200c5580 0x7fbb201ef690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 --2- 172.21.15.133:0/4240895462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb200c51a0 0x7fbb201f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 >> 172.21.15.133:0/4240895462 conn(0x7fbb200cb3e0 msgr2=0x7fbb2014e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 shutdown_connections 2024-01-19T04:32:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.245+0000 7fbb273a2640 1 -- 172.21.15.133:0/4240895462 wait complete. 2024-01-19T04:32:35.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:32:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497bdf8640 1 Processor -- start 2024-01-19T04:32:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497bdf8640 1 -- start start 2024-01-19T04:32:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497bdf8640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4974072170 0x7f497415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497bdf8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49740c75d0 con 0x7f4974153750 2024-01-19T04:32:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497bdf8640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49740c69c0 con 0x7f49740c7a60 2024-01-19T04:32:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497bdf8640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49740c67b0 con 0x7f4974072170 2024-01-19T04:32:35.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.385+0000 7f497a395640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4974072170 0x7f497415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.389+0000 7f4979b94640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4974153750 0x7f497406a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33904/0 (socket says 172.21.15.133:33904) 2024-01-19T04:32:35.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.389+0000 7f4979b94640 1 -- 172.21.15.133:0/1444296012 learned_addr learned my addr 172.21.15.133:0/1444296012 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:35.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.393+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552824188 0 0) 0x7f49740c75d0 con 0x7f4974153750 2024-01-19T04:32:35.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.393+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4960003530 con 0x7f4974153750 2024-01-19T04:32:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1143184877 0 0) 0x7f4960003530 con 0x7f4974153750 2024-01-19T04:32:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 >> v2:172.21.15.156:3300/0 conn(0x7f4974072170 msgr2=0x7f497415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 --2- 172.21.15.133:0/1444296012 >> v2:172.21.15.156:3300/0 conn(0x7f4974072170 0x7f497415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 >> v1:172.21.15.156:6789/0 conn(0x7f49740c7a60 legacy=0x7f497415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49740c6ca0 con 0x7f4974153750 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f4970001680 con 0x7f4974153750 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 >> v1:172.21.15.133:6789/0 conn(0x7f4974153750 legacy=0x7f497406a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49600039d0 0x7f4960003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49600047d0 0x7f4960004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4960005190 0x7f496000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49740c67b0 con 0x7f49600039d0 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496000c040 con 0x7f49600047d0 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496000c200 con 0x7f4960005190 2024-01-19T04:32:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.397+0000 7f4979b94640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49600039d0 0x7f4960003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f497a395640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4960005190 0x7f496000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f4979b94640 1 -- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4960005190 msgr2=0x7f496000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f4979b94640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4960005190 0x7f496000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f4979b94640 1 -- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49600047d0 msgr2=0x7f4960004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f4979b94640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49600047d0 0x7f4960004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f4979b94640 1 -- 172.21.15.133:0/1444296012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960003530 con 0x7f49600039d0 2024-01-19T04:32:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.401+0000 7f497a395640 1 -- 172.21.15.133:0/1444296012 reap_dead start 2024-01-19T04:32:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.409+0000 7f4979b94640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49600039d0 0x7f4960003dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f497000c190 tx=0x7f497001f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7820eedd973556 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700a8e90 con 0x7f49600039d0 2024-01-19T04:32:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49700058e0 con 0x7f49600039d0 2024-01-19T04:32:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f4978b92640 1 -- 172.21.15.133:0/1444296012 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970005d10 con 0x7f49600039d0 2024-01-19T04:32:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- 172.21.15.133:0/1444296012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49600039d0 msgr2=0x7f4960003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49600039d0 0x7f4960003dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f497000c190 tx=0x7f497001f2f0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- 172.21.15.133:0/1444296012 shutdown_connections 2024-01-19T04:32:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 --2- 172.21.15.133:0/1444296012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49600039d0 0x7f4960003dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- 172.21.15.133:0/1444296012 >> 172.21.15.133:0/1444296012 conn(0x7f49740cbb60 msgr2=0x7f49740c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- 172.21.15.133:0/1444296012 shutdown_connections 2024-01-19T04:32:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- 172.21.15.133:0/1444296012 wait complete. 2024-01-19T04:32:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 Processor -- start 2024-01-19T04:32:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- start start 2024-01-19T04:32:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 0x7f49741f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4974149ae0 0x7f4974148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f497414ff30 0x7f4974150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49741f3080 con 0x7f497414ff30 2024-01-19T04:32:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974144620 con 0x7f4974149ae0 2024-01-19T04:32:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.413+0000 7f497bdf8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49741448c0 con 0x7f49600039d0 2024-01-19T04:32:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.417+0000 7f4979b94640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 0x7f49741f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.417+0000 7f4979b94640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 0x7f49741f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43906/0 (socket says 172.21.15.133:43906) 2024-01-19T04:32:35.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.417+0000 7f4979b94640 1 -- 172.21.15.133:0/3994130366 learned_addr learned my addr 172.21.15.133:0/3994130366 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:35.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.417+0000 7f497a395640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f497414ff30 0x7f4974150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.421+0000 7f4979393640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4974149ae0 0x7f4974148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.425+0000 7f4979b94640 1 -- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4974149ae0 msgr2=0x7f4974148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:35.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.425+0000 7f4979b94640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4974149ae0 0x7f4974148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.425+0000 7f4979b94640 1 -- 172.21.15.133:0/3994130366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f497414ff30 msgr2=0x7f4974150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:35.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.425+0000 7f4979b94640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f497414ff30 0x7f4974150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:35.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.425+0000 7f4979b94640 1 -- 172.21.15.133:0/3994130366 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974144ba0 con 0x7f49600039d0 2024-01-19T04:32:35.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.433+0000 7f4979b94640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 0x7f49741f2b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f497000c190 tx=0x7f4960005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:35.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.453+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700b7070 con 0x7f49600039d0 2024-01-19T04:32:35.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.453+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970001440 con 0x7f49600039d0 2024-01-19T04:32:35.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.453+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700b2a50 con 0x7f49600039d0 2024-01-19T04:32:35.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.453+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4974144e80 con 0x7f49600039d0 2024-01-19T04:32:35.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.453+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4974145440 con 0x7f49600039d0 2024-01-19T04:32:35.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.453+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974072a10 con 0x7f49600039d0 2024-01-19T04:32:35.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.833+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f49700b2bd0 con 0x7f49600039d0 2024-01-19T04:32:35.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.833+0000 7f496a7fc640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4958066550 0x7f4958068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:35.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.833+0000 7f4979393640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4958066550 0x7f4958068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:35.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.833+0000 7f4979393640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4958066550 0x7f4958068a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4974149ec0 tx=0x7f4964009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.849+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6489+0+0 (secure 0 0 0) 0x7f49700f20f0 con 0x7f49600039d0 2024-01-19T04:32:35.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:35.881+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f49700ee430 con 0x7f49600039d0 2024-01-19T04:32:36.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.097+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4974074340 con 0x7f49600039d0 2024-01-19T04:32:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f496a7fc640 1 -- 172.21.15.133:0/3994130366 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6593 (secure 0 0 0) 0x7f49700c1090 con 0x7f49600039d0 2024-01-19T04:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:32:27.725491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4247,"mds_1":4238,"mds_2":4235,"mds_3":4224,"mds_4":4219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4219":{"gid":4219,"name":"d","rank":4,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4224":{"gid":4224,"name":"c","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"a","rank":1,"incarnation":11,"state":"up:active","state_seq":17,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:32:36.150 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-01-19T04:32:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4958066550 msgr2=0x7f4958068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4958066550 0x7f4958068a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4974149ec0 tx=0x7f4964009040 comp rx=0 tx=0).stop 2024-01-19T04:32:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 msgr2=0x7f49741f2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 0x7f49741f2b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f497000c190 tx=0x7f4960005800 comp rx=0 tx=0).stop 2024-01-19T04:32:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 shutdown_connections 2024-01-19T04:32:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4958066550 0x7f4958068a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4974149ae0 0x7f4974148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f497414ff30 0x7f4974150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 --2- 172.21.15.133:0/3994130366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49600039d0 0x7f49741f2b40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 >> 172.21.15.133:0/3994130366 conn(0x7f49740cbb60 msgr2=0x7f497414ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 shutdown_connections 2024-01-19T04:32:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.149+0000 7f497bdf8640 1 -- 172.21.15.133:0/3994130366 wait complete. 2024-01-19T04:32:36.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:32:36.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd64dc5640 1 Processor -- start 2024-01-19T04:32:36.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd64dc5640 1 -- start start 2024-01-19T04:32:36.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd64dc5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd600c7290 0x7fdd60071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:36.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd64dc5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600c6010 con 0x7fdd6014fe10 2024-01-19T04:32:36.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd64dc5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600c7d70 con 0x7fdd60072a10 2024-01-19T04:32:36.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd64dc5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd600723d0 con 0x7fdd600c7290 2024-01-19T04:32:36.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd5dd9b640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdd60072a10 0x7fdd60071780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:57112/0 (socket says 172.21.15.133:57112) 2024-01-19T04:32:36.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.297+0000 7fdd5dd9b640 1 -- 172.21.15.133:0/1145881616 learned_addr learned my addr 172.21.15.133:0/1145881616 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:36.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.305+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596433602 0 0) 0x7fdd600c7d70 con 0x7fdd60072a10 2024-01-19T04:32:36.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.305+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd48004640 con 0x7fdd60072a10 2024-01-19T04:32:36.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.309+0000 7fdd5ed9d640 1 --2- 172.21.15.133:0/1145881616 >> v2:172.21.15.133:3300/0 conn(0x7fdd600c7290 0x7fdd60071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:36.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.309+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625282523 0 0) 0x7fdd600c6010 con 0x7fdd6014fe10 2024-01-19T04:32:36.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.309+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd600c7d70 con 0x7fdd6014fe10 2024-01-19T04:32:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.313+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/1145881616 >> v1:172.21.15.156:6789/0 conn(0x7fdd60072a10 legacy=0x7fdd60071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.313+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/1145881616 >> v1:172.21.15.133:6789/0 conn(0x7fdd6014fe10 legacy=0x7fdd60155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.313+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/1145881616 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600c77d0 con 0x7fdd600c7290 2024-01-19T04:32:36.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.321+0000 7fdd5ed9d640 1 --2- 172.21.15.133:0/1145881616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd600c7290 0x7fdd60071e90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009d90 tx=0x7fdd5801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb6dc9a95bf73e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:36.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.325+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580a7ba0 con 0x7fdd600c7290 2024-01-19T04:32:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580a7d00 con 0x7fdd600c7290 2024-01-19T04:32:36.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd5d59a640 1 -- 172.21.15.133:0/1145881616 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580af640 con 0x7fdd600c7290 2024-01-19T04:32:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 -- 172.21.15.133:0/1145881616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd600c7290 msgr2=0x7fdd60071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/1145881616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd600c7290 0x7fdd60071e90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009d90 tx=0x7fdd5801eb30 comp rx=0 tx=0).stop 2024-01-19T04:32:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 -- 172.21.15.133:0/1145881616 shutdown_connections 2024-01-19T04:32:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/1145881616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd600c7290 0x7fdd60071e90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 -- 172.21.15.133:0/1145881616 >> 172.21.15.133:0/1145881616 conn(0x7fdd600cba50 msgr2=0x7fdd600c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 -- 172.21.15.133:0/1145881616 shutdown_connections 2024-01-19T04:32:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.329+0000 7fdd64dc5640 1 -- 172.21.15.133:0/1145881616 wait complete. 2024-01-19T04:32:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 Processor -- start 2024-01-19T04:32:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 -- start start 2024-01-19T04:32:36.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd60072a10 0x7fdd6014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:36.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd600c7290 0x7fdd601392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:36.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 0x7fdd600ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:36.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6014f570 con 0x7fdd6014fe10 2024-01-19T04:32:36.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6013b6b0 con 0x7fdd600c7290 2024-01-19T04:32:36.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd64dc5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6014e560 con 0x7fdd60072a10 2024-01-19T04:32:36.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd5ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 0x7fdd600ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:36.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd5ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 0x7fdd600ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50206/0 (socket says 172.21.15.133:50206) 2024-01-19T04:32:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/2456366317 learned_addr learned my addr 172.21.15.133:0/2456366317 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:36.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.333+0000 7fdd5e59c640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd60072a10 0x7fdd6014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.337+0000 7fdd5dd9b640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd600c7290 0x7fdd601392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:36.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.337+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd60072a10 msgr2=0x7fdd6014b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.337+0000 7fdd5ed9d640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd60072a10 0x7fdd6014b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.337+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd600c7290 msgr2=0x7fdd601392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.337+0000 7fdd5ed9d640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd600c7290 0x7fdd601392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.337+0000 7fdd5ed9d640 1 -- 172.21.15.133:0/2456366317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58009a70 con 0x7fdd6014fe10 2024-01-19T04:32:36.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.341+0000 7fdd5ed9d640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 0x7fdd600ca2a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd5801b740 tx=0x7fdd5801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:36.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.345+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58004240 con 0x7fdd6014fe10 2024-01-19T04:32:36.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.345+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580043a0 con 0x7fdd6014fe10 2024-01-19T04:32:36.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.345+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58004710 con 0x7fdd6014fe10 2024-01-19T04:32:36.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.345+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6006f990 con 0x7fdd6014fe10 2024-01-19T04:32:36.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.345+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6013b8e0 con 0x7fdd6014fe10 2024-01-19T04:32:36.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.345+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6014e6f0 con 0x7fdd6014fe10 2024-01-19T04:32:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.365+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdd580af440 con 0x7fdd6014fe10 2024-01-19T04:32:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.365+0000 7fdd4effd640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdd40066550 0x7fdd40068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.369+0000 7fdd5e59c640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdd40066550 0x7fdd40068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:36.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.369+0000 7fdd5e59c640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdd40066550 0x7fdd40068a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001720 tx=0x7fdd50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.369+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd580f3130 con 0x7fdd6014fe10 2024-01-19T04:32:36.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.641+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdd580eed70 con 0x7fdd6014fe10 2024-01-19T04:32:36.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.821+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd6014e6a0 con 0x7fdd6014fe10 2024-01-19T04:32:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.881+0000 7fdd4effd640 1 -- 172.21.15.133:0/2456366317 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18782 (secure 0 0 0) 0x7fdd580b4070 con 0x7fdd6014fe10 2024-01-19T04:32:36.883 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:36.883 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:32:35.756896+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:32:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdd40066550 msgr2=0x7fdd40068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdd40066550 0x7fdd40068a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001720 tx=0x7fdd50009040 comp rx=0 tx=0).stop 2024-01-19T04:32:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 msgr2=0x7fdd600ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 0x7fdd600ca2a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd5801b740 tx=0x7fdd5801b8d0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 shutdown_connections 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fdd40066550 0x7fdd40068a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd600c7290 0x7fdd601392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6014fe10 0x7fdd600ca2a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 --2- 172.21.15.133:0/2456366317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd60072a10 0x7fdd6014b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 >> 172.21.15.133:0/2456366317 conn(0x7fdd600cba50 msgr2=0x7fdd6013f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 shutdown_connections 2024-01-19T04:32:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:36.885+0000 7fdd64dc5640 1 -- 172.21.15.133:0/2456366317 wait complete. 2024-01-19T04:32:36.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:32:37.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.033+0000 7fd064e87640 1 Processor -- start 2024-01-19T04:32:37.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.033+0000 7fd064e87640 1 -- start start 2024-01-19T04:32:37.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd064e87640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd0600cc120 0x7fd0600c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:37.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd064e87640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0600cc560 0x7fd0600c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:37.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd064e87640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd060159740 con 0x7fd060153960 2024-01-19T04:32:37.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd064e87640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd060153d40 con 0x7fd0600cc560 2024-01-19T04:32:37.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd064e87640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0601599e0 con 0x7fd0600cc120 2024-01-19T04:32:37.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0600cc560 0x7fd0600c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:37.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0600cc560 0x7fd0600c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50218/0 (socket says 172.21.15.133:50218) 2024-01-19T04:32:37.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 -- 172.21.15.133:0/3857821632 learned_addr learned my addr 172.21.15.133:0/3857821632 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:37.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 -- 172.21.15.133:0/3857821632 >> v2:172.21.15.156:3300/0 conn(0x7fd0600cc120 msgr2=0x7fd0600c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:37.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 --2- 172.21.15.133:0/3857821632 >> v2:172.21.15.156:3300/0 conn(0x7fd0600cc120 0x7fd0600c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 -- 172.21.15.133:0/3857821632 >> v1:172.21.15.156:6789/0 conn(0x7fd060153960 legacy=0x7fd0600c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:37.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.037+0000 7fd05ed9d640 1 -- 172.21.15.133:0/3857821632 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060159cc0 con 0x7fd0600cc560 2024-01-19T04:32:37.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.041+0000 7fd05ed9d640 1 --2- 172.21.15.133:0/3857821632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0600cc560 0x7fd0600c4320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd0600cca60 tx=0x7fd05801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e01da4b7f3f12f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:37.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd05d59a640 1 -- 172.21.15.133:0/3857821632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580a89b0 con 0x7fd0600cc560 2024-01-19T04:32:37.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd05d59a640 1 -- 172.21.15.133:0/3857821632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0580a8b10 con 0x7fd0600cc560 2024-01-19T04:32:37.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd05d59a640 1 -- 172.21.15.133:0/3857821632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580a8ea0 con 0x7fd0600cc560 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 -- 172.21.15.133:0/3857821632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0600cc560 msgr2=0x7fd0600c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 --2- 172.21.15.133:0/3857821632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0600cc560 0x7fd0600c4320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd0600cca60 tx=0x7fd05801ecb0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 -- 172.21.15.133:0/3857821632 shutdown_connections 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 --2- 172.21.15.133:0/3857821632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0600cc560 0x7fd0600c4320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 --2- 172.21.15.133:0/3857821632 >> v2:172.21.15.156:3300/0 conn(0x7fd0600cc120 0x7fd0600c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 -- 172.21.15.133:0/3857821632 >> 172.21.15.133:0/3857821632 conn(0x7fd06008afa0 msgr2=0x7fd06008b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 -- 172.21.15.133:0/3857821632 shutdown_connections 2024-01-19T04:32:37.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.045+0000 7fd064e87640 1 -- 172.21.15.133:0/3857821632 wait complete. 2024-01-19T04:32:37.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 Processor -- start 2024-01-19T04:32:37.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 -- start start 2024-01-19T04:32:37.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0600cc120 0x7fd060150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:37.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0600cc560 0x7fd060148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:37.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 0x7fd0601f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:37.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060150180 con 0x7fd060153960 2024-01-19T04:32:37.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014cfe0 con 0x7fd0600cc120 2024-01-19T04:32:37.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd064e87640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014f850 con 0x7fd0600cc560 2024-01-19T04:32:37.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd05ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 0x7fd0601f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:37.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd05ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 0x7fd0601f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50220/0 (socket says 172.21.15.133:50220) 2024-01-19T04:32:37.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.049+0000 7fd05ed9d640 1 -- 172.21.15.133:0/2249292038 learned_addr learned my addr 172.21.15.133:0/2249292038 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:37.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.053+0000 7fd05ed9d640 1 -- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0600cc560 msgr2=0x7fd060148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:37.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.053+0000 7fd05ed9d640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0600cc560 0x7fd060148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.053+0000 7fd05ed9d640 1 -- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0600cc120 msgr2=0x7fd060150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:37.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.053+0000 7fd05ed9d640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0600cc120 0x7fd060150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.053+0000 7fd05ed9d640 1 -- 172.21.15.133:0/2249292038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580094d0 con 0x7fd060153960 2024-01-19T04:32:37.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.053+0000 7fd05ed9d640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 0x7fd0601f26d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd05801b8c0 tx=0x7fd05801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:37.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.057+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580b0da0 con 0x7fd060153960 2024-01-19T04:32:37.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.057+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0580ba440 con 0x7fd060153960 2024-01-19T04:32:37.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.057+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580ba7f0 con 0x7fd060153960 2024-01-19T04:32:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.057+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06014d1f0 con 0x7fd060153960 2024-01-19T04:32:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.057+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06014fac0 con 0x7fd060153960 2024-01-19T04:32:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.061+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd060074340 con 0x7fd060153960 2024-01-19T04:32:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.081+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd0580ba950 con 0x7fd060153960 2024-01-19T04:32:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.081+0000 7fd04effd640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd040066550 0x7fd040068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.081+0000 7fd05e59c640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd040066550 0x7fd040068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.081+0000 7fd05e59c640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd040066550 0x7fd040068a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd05000abb0 tx=0x7fd050009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:37.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.361+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0580aee20 con 0x7fd060153960 2024-01-19T04:32:37.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.361+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd0580efb40 con 0x7fd060153960 2024-01-19T04:32:37.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.589+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd060074340 con 0x7fd060153960 2024-01-19T04:32:37.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.625+0000 7fd04effd640 1 -- 172.21.15.133:0/2249292038 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6593 (secure 0 0 0) 0x7fd0580b5020 con 0x7fd060153960 2024-01-19T04:32:37.627 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T04:32:37.627 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:32:27.725491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4247,"mds_1":4238,"mds_2":4235,"mds_3":4224,"mds_4":4219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4219":{"gid":4219,"name":"d","rank":4,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4224":{"gid":4224,"name":"c","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"a","rank":1,"incarnation":11,"state":"up:active","state_seq":17,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:32:37.627 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-01-19T04:32:37.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd040066550 msgr2=0x7fd040068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd040066550 0x7fd040068a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd05000abb0 tx=0x7fd050009250 comp rx=0 tx=0).stop 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 msgr2=0x7fd0601f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 0x7fd0601f26d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd05801b8c0 tx=0x7fd05801ba50 comp rx=0 tx=0).stop 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 shutdown_connections 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd040066550 0x7fd040068a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd060153960 0x7fd0601f26d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0600cc560 0x7fd060148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 --2- 172.21.15.133:0/2249292038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0600cc120 0x7fd060150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 >> 172.21.15.133:0/2249292038 conn(0x7fd06008afa0 msgr2=0x7fd0601514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 shutdown_connections 2024-01-19T04:32:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:37.629+0000 7fd064e87640 1 -- 172.21.15.133:0/2249292038 wait complete. 2024-01-19T04:32:38.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:32:38.050 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:32:38.252 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T04:31:32.688148+0000', 'modified': '2024-01-19T04:32:27.725491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4247, 'mds_1': 4238, 'mds_2': 4235, 'mds_3': 4224, 'mds_4': 4219}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4219': {'gid': 4219, 'name': 'd', 'rank': 4, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.156:6837/1010982960', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 1010982960}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 1010982960}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4224': {'gid': 4224, 'name': 'c', 'rank': 3, 'incarnation': 17, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.133:6833/383272692', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 383272692}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 383272692}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4235': {'gid': 4235, 'name': 'f', 'rank': 2, 'incarnation': 15, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.156:6839/1170572203', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 1170572203}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 1170572203}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4238': {'gid': 4238, 'name': 'a', 'rank': 1, 'incarnation': 11, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.133:6835/3627758076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3627758076}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 3627758076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4247': {'gid': 4247, 'name': 'e', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6837/3631439971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3631439971}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3631439971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T04:32:38.253 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-19T04:32:38.253 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-19T04:32:38.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 Processor -- start 2024-01-19T04:32:38.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 -- start start 2024-01-19T04:32:38.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ab80716d0 0x7f1ab8159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab815a4f0 con 0x7f1ab80cba20 2024-01-19T04:32:38.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80cbef0 con 0x7f1ab80716d0 2024-01-19T04:32:38.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.393+0000 7f1abea2c640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab815cb20 con 0x7f1ab8071ab0 2024-01-19T04:32:38.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.397+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.401+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab8152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43932/0 (socket says 172.21.15.133:43932) 2024-01-19T04:32:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.401+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2545889217 learned_addr learned my addr 172.21.15.133:0/2545889217 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:38.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.405+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/2545889217 >> v2:172.21.15.156:3300/0 conn(0x7f1ab80716d0 0x7f1ab8159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.409+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2545889217 >> v2:172.21.15.156:3300/0 conn(0x7f1ab80716d0 msgr2=0x7f1ab8159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.409+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2545889217 >> v2:172.21.15.156:3300/0 conn(0x7f1ab80716d0 0x7f1ab8159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.409+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2545889217 >> v1:172.21.15.156:6789/0 conn(0x7f1ab80cba20 legacy=0x7f1ab80c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.409+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2545889217 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab815ce00 con 0x7f1ab8071ab0 2024-01-19T04:32:38.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.413+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2545889217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab8152fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80098a0 tx=0x7f1aa801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cdd846b92cda59c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2545889217 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80a8990 con 0x7f1ab8071ab0 2024-01-19T04:32:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2545889217 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa80a8af0 con 0x7f1ab8071ab0 2024-01-19T04:32:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2545889217 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80a8e80 con 0x7f1ab8071ab0 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 -- 172.21.15.133:0/2545889217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 msgr2=0x7f1ab8152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 --2- 172.21.15.133:0/2545889217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab8152fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80098a0 tx=0x7f1aa801ecd0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 -- 172.21.15.133:0/2545889217 shutdown_connections 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 --2- 172.21.15.133:0/2545889217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab8152fd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 --2- 172.21.15.133:0/2545889217 >> v2:172.21.15.156:3300/0 conn(0x7f1ab80716d0 0x7f1ab8159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 -- 172.21.15.133:0/2545889217 >> 172.21.15.133:0/2545889217 conn(0x7f1ab8066a60 msgr2=0x7f1ab806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 -- 172.21.15.133:0/2545889217 shutdown_connections 2024-01-19T04:32:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 -- 172.21.15.133:0/2545889217 wait complete. 2024-01-19T04:32:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 Processor -- start 2024-01-19T04:32:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.425+0000 7f1abea2c640 1 -- start start 2024-01-19T04:32:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1abea2c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab80716d0 0x7f1ab81f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1abea2c640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab806ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1abea2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80cba20 0x7f1ab814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1abea2c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8159fa0 con 0x7f1ab80cba20 2024-01-19T04:32:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1abea2c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81f26e0 con 0x7f1ab80716d0 2024-01-19T04:32:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1abea2c640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8154510 con 0x7f1ab8071ab0 2024-01-19T04:32:38.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.429+0000 7f1ab77fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab806ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.433+0000 7f1ab77fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab806ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43944/0 (socket says 172.21.15.133:43944) 2024-01-19T04:32:38.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.433+0000 7f1ab77fe640 1 -- 172.21.15.133:0/3329703325 learned_addr learned my addr 172.21.15.133:0/3329703325 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.433+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80cba20 0x7f1ab814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.441+0000 7f1ab77fe640 1 -- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab80716d0 msgr2=0x7f1ab81f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.441+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab80716d0 0x7f1ab81f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.441+0000 7f1ab77fe640 1 -- 172.21.15.133:0/3329703325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80cba20 msgr2=0x7f1ab814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.441+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80cba20 0x7f1ab814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.441+0000 7f1ab77fe640 1 -- 172.21.15.133:0/3329703325 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80094d0 con 0x7f1ab8071ab0 2024-01-19T04:32:38.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.449+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab806ef20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000b3f0 tx=0x7f1aa000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.465+0000 7f1ab4ff9640 1 -- 172.21.15.133:0/3329703325 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011830 con 0x7f1ab8071ab0 2024-01-19T04:32:38.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.465+0000 7f1ab4ff9640 1 -- 172.21.15.133:0/3329703325 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0011990 con 0x7f1ab8071ab0 2024-01-19T04:32:38.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.465+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab81f23b0 con 0x7f1ab8071ab0 2024-01-19T04:32:38.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.465+0000 7f1ab4ff9640 1 -- 172.21.15.133:0/3329703325 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011d20 con 0x7f1ab8071ab0 2024-01-19T04:32:38.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.465+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab8159cc0 con 0x7f1ab8071ab0 2024-01-19T04:32:38.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 Processor -- start 2024-01-19T04:32:38.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 -- start start 2024-01-19T04:32:38.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a346b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a381bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a38ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a19cd70 con 0x561c2a346730 2024-01-19T04:32:38.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a198ba0 con 0x561c2a3817d0 2024-01-19T04:32:38.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.469+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c2a1960d0 con 0x561c2a3820f0 2024-01-19T04:32:38.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.477+0000 7f1ab77fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a38ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.481+0000 7f1ab77fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a38ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:43954/0 (socket says 172.21.15.133:43954) 2024-01-19T04:32:38.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.481+0000 7f1ab77fe640 1 -- 172.21.15.133:0/2283465906 learned_addr learned my addr 172.21.15.133:0/2283465906 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:38.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.489+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a346b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.489+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a381bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.497+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 msgr2=0x561c2a38ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.497+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a38ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.497+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 msgr2=0x561c2a381bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.497+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a381bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.497+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2283465906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c29e88890 con 0x561c2a346730 2024-01-19T04:32:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.501+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a346b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80af000 tx=0x7f1aa80aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8577f8d6f9407dd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1aadffb640 1 -- 172.21.15.133:0/2283465906 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80b0640 con 0x561c2a346730 2024-01-19T04:32:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1aadffb640 1 -- 172.21.15.133:0/2283465906 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa80b07a0 con 0x561c2a346730 2024-01-19T04:32:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1aadffb640 1 -- 172.21.15.133:0/2283465906 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80b0b50 con 0x561c2a346730 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2283465906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 msgr2=0x561c2a346b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a346b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80af000 tx=0x7f1aa80aa070 comp rx=0 tx=0).stop 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2283465906 shutdown_connections 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a381bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a38ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2283465906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a346b10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2283465906 >> 172.21.15.133:0/2283465906 conn(0x561c2a37d580 msgr2=0x561c2a37f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2283465906 shutdown_connections 2024-01-19T04:32:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.505+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2283465906 wait complete. 2024-01-19T04:32:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 -- start start 2024-01-19T04:32:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 Processor -- start 2024-01-19T04:32:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a37bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a37c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a388950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a1919c0 con 0x561c2a346730 2024-01-19T04:32:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a149040 con 0x561c2a3817d0 2024-01-19T04:32:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c2a14eee0 con 0x561c2a3820f0 2024-01-19T04:32:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1ac1b89000 10 client.0 _ll_register_callbacks cb 0x561c2a14c1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a37bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a37bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50250/0 (socket says 172.21.15.133:50250) 2024-01-19T04:32:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.509+0000 7f1abcfc9640 1 -- 172.21.15.133:0/146995761 learned_addr learned my addr 172.21.15.133:0/146995761 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:38.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1abcfc9640 1 -- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 msgr2=0x561c2a388950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a388950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1abcfc9640 1 -- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 msgr2=0x561c2a37c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a37c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1abcfc9640 1 -- 172.21.15.133:0/146995761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab815ce00 con 0x561c2a346730 2024-01-19T04:32:38.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a37bd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1aa801d380 tx=0x7f1aa801d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7886473c0d460f37 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.513+0000 7f1a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:38.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.517+0000 7f1a96ffd640 1 -- 172.21.15.133:0/146995761 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003820 con 0x561c2a346730 2024-01-19T04:32:38.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.517+0000 7f1a96ffd640 1 -- 172.21.15.133:0/146995761 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1aa8003980 con 0x561c2a346730 2024-01-19T04:32:38.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.517+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c2a117e30 con 0x561c2a346730 2024-01-19T04:32:38.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.521+0000 7f1a96ffd640 1 -- 172.21.15.133:0/146995761 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa8003b40 con 0x561c2a346730 2024-01-19T04:32:38.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.521+0000 7f1ac1b89000 10 client.4677 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:38.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.521+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x561c2a1515e0 con 0x561c2a346730 2024-01-19T04:32:38.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1a96ffd640 1 -- 172.21.15.133:0/146995761 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c2a117e30 con 0x561c2a346730 2024-01-19T04:32:38.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1a96ffd640 1 -- 172.21.15.133:0/146995761 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1aa8003ca0 con 0x561c2a346730 2024-01-19T04:32:38.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ac1b89000 10 client.4677 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:38.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ac1b89000 10 client.4677 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-19T04:32:38.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ac1b89000 20 client.4677 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:38.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3896c0 0x561c2a389aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ac1b89000 4 client.4677 mds_command: new command op to 4219 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:32:38.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 --> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c2a14e870 con 0x561c2a3896c0 2024-01-19T04:32:38.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.525+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3896c0 0x561c2a389aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.617+0000 7f1ab4ff9640 1 -- 172.21.15.133:0/3329703325 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1aa001a410 con 0x7f1ab8071ab0 2024-01-19T04:32:38.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.617+0000 7f1ab4ff9640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a980664f0 0x7f1a980689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.617+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a980664f0 0x7f1a980689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.621+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a980664f0 0x7f1a980689b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1aa005ce00 tx=0x7f1aa0051370 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.625+0000 7f1ab4ff9640 1 -- 172.21.15.133:0/3329703325 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1aa005e1f0 con 0x7f1ab8071ab0 2024-01-19T04:32:38.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.633+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3896c0 0x561c2a389aa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=231a0a1078b1571 server_cookie=685b830d7e857db1 in_seq=0 out_seq=0 2024-01-19T04:32:38.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.633+0000 7f1a96ffd640 10 client.4677 ms_handle_connect on v2:172.21.15.156:6836/1010982960 2024-01-19T04:32:38.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1a96ffd640 1 -- 172.21.15.133:0/146995761 <== mds.4 v2:172.21.15.156:6836/1010982960 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561c2a14e870 con 0x561c2a3896c0 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1a96ffd640 10 client.4677 handle_command_reply: tid=0 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 client.4677 shutdown 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 msgr2=0x561c2a37bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a37bd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1aa801d380 tx=0x7f1aa801d510 comp rx=0 tx=0).stop 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 shutdown_connections 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3896c0 0x561c2a389aa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a37c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1a96ffd640 0 client.4677 ms_handle_reset on v2:172.21.15.156:6836/1010982960 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3820f0 0x561c2a388950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/146995761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a346730 0x561c2a37bd00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.841+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 >> 172.21.15.133:0/146995761 conn(0x561c2a37d580 msgr2=0x561c2a37cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.845+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 shutdown_connections 2024-01-19T04:32:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.845+0000 7f1ac1b89000 1 -- 172.21.15.133:0/146995761 wait complete. 2024-01-19T04:32:38.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.845+0000 7f1ac1b89000 20 client.4677 trim_cache size 0 max 16384 2024-01-19T04:32:38.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 Processor -- start 2024-01-19T04:32:38.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 -- start start 2024-01-19T04:32:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a346730 0x561c2a394670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a38acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a38b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c29e49940 con 0x561c2a3820f0 2024-01-19T04:32:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a192270 con 0x561c2a3817d0 2024-01-19T04:32:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c2a1911d0 con 0x561c2a346730 2024-01-19T04:32:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a38b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a346730 0x561c2a394670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a38b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50266/0 (socket says 172.21.15.133:50266) 2024-01-19T04:32:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.897+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2075547783 learned_addr learned my addr 172.21.15.133:0/2075547783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:38.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.901+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2075547783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a346730 msgr2=0x561c2a394670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.901+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a346730 0x561c2a394670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.901+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2075547783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 msgr2=0x561c2a38acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.901+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a38acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.901+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2075547783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c2a1378e0 con 0x561c2a3820f0 2024-01-19T04:32:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.905+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a38b200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80203b0 tx=0x7f1aa80c4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636bd222e9b413b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1aad7fa640 1 -- 172.21.15.133:0/2075547783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8004350 con 0x561c2a3820f0 2024-01-19T04:32:38.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1aad7fa640 1 -- 172.21.15.133:0/2075547783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa80c2780 con 0x561c2a3820f0 2024-01-19T04:32:38.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1aad7fa640 1 -- 172.21.15.133:0/2075547783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80c2af0 con 0x561c2a3820f0 2024-01-19T04:32:38.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2075547783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 msgr2=0x561c2a38b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a38b200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80203b0 tx=0x7f1aa80c4040 comp rx=0 tx=0).stop 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2075547783 shutdown_connections 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a3817d0 0x561c2a38acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a38b200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2075547783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a346730 0x561c2a394670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2075547783 >> 172.21.15.133:0/2075547783 conn(0x561c2a37d580 msgr2=0x561c2a37cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2075547783 shutdown_connections 2024-01-19T04:32:38.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2075547783 wait complete. 2024-01-19T04:32:38.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 -- start start 2024-01-19T04:32:38.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.913+0000 7f1ac1b89000 1 Processor -- start 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a346730 0x561c2a344580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3817d0 0x561c2a344ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a345000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a1d2440 con 0x561c2a3820f0 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2a153720 con 0x561c2a346730 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c2a188a40 con 0x561c2a3817d0 2024-01-19T04:32:38.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ac1b89000 10 client.0 _ll_register_callbacks cb 0x561c2a1bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:38.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a345000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1abcfc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a345000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50282/0 (socket says 172.21.15.133:50282) 2024-01-19T04:32:38.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2132973892 learned_addr learned my addr 172.21.15.133:0/2132973892 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:38.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3817d0 0x561c2a344ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.917+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a346730 0x561c2a344580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3817d0 msgr2=0x561c2a344ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3817d0 0x561c2a344ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a346730 msgr2=0x561c2a344580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:38.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a346730 0x561c2a344580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1abcfc9640 1 -- 172.21.15.133:0/2132973892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c2a1515e0 con 0x561c2a3820f0 2024-01-19T04:32:38.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1abcfc9640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a345000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1aa809b4b0 tx=0x7f1aa80cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb751f411edc5ae9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:38.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.921+0000 7f1a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:38.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.925+0000 7f1a96ffd640 1 -- 172.21.15.133:0/2132973892 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003820 con 0x561c2a3820f0 2024-01-19T04:32:38.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.925+0000 7f1a96ffd640 1 -- 172.21.15.133:0/2132973892 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1aa80c2b00 con 0x561c2a3820f0 2024-01-19T04:32:38.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.925+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c2a1434f0 con 0x561c2a3820f0 2024-01-19T04:32:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.929+0000 7f1a96ffd640 1 -- 172.21.15.133:0/2132973892 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa8003980 con 0x561c2a3820f0 2024-01-19T04:32:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.929+0000 7f1ac1b89000 10 client.4683 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.929+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x561c29e88cc0 con 0x561c2a3820f0 2024-01-19T04:32:38.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.933+0000 7f1a96ffd640 1 -- 172.21.15.133:0/2132973892 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c2a1434f0 con 0x561c2a3820f0 2024-01-19T04:32:38.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.933+0000 7f1a96ffd640 1 -- 172.21.15.133:0/2132973892 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f1aa8003ae0 con 0x561c2a3820f0 2024-01-19T04:32:38.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ac1b89000 10 client.4683 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:38.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ac1b89000 10 client.4683 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-19T04:32:38.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ac1b89000 20 client.4683 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:38.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3ecca0 0x561c2a3ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:38.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ac1b89000 4 client.4683 mds_command: new command op to 4219 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:32:38.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 --> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561c2a190310 con 0x561c2a3ecca0 2024-01-19T04:32:38.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.937+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3ecca0 0x561c2a3ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:38.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.941+0000 7f1ab7fff640 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3ecca0 0x561c2a3ef090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5ed7d29bdb2a1cfa server_cookie=70eb3a9a82fdbc3b in_seq=0 out_seq=0 2024-01-19T04:32:38.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.941+0000 7f1a96ffd640 10 client.4683 ms_handle_connect on v2:172.21.15.156:6836/1010982960 2024-01-19T04:32:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1a96ffd640 1 -- 172.21.15.133:0/2132973892 <== mds.4 v2:172.21.15.156:6836/1010982960 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561c2a190310 con 0x561c2a3ecca0 2024-01-19T04:32:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1a96ffd640 10 client.4683 handle_command_reply: tid=0 2024-01-19T04:32:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 client.4683 shutdown 2024-01-19T04:32:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 msgr2=0x561c2a345000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a345000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1aa809b4b0 tx=0x7f1aa80cc040 comp rx=0 tx=0).stop 2024-01-19T04:32:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 shutdown_connections 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:6836/1010982960,v1:172.21.15.156:6837/1010982960] conn(0x561c2a3ecca0 0x561c2a3ef090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561c2a3820f0 0x561c2a345000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x561c2a3817d0 0x561c2a344ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 --2- 172.21.15.133:0/2132973892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c2a346730 0x561c2a344580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 >> 172.21.15.133:0/2132973892 conn(0x561c2a37d580 msgr2=0x561c2a37b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1a96ffd640 0 client.4683 ms_handle_reset on v2:172.21.15.156:6836/1010982960 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 shutdown_connections 2024-01-19T04:32:38.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 1 -- 172.21.15.133:0/2132973892 wait complete. 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1ac1b89000 20 client.4683 trim_cache size 0 max 16384 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "d3166d6e-d1d2-4f45-9af8-af169e4e9af8", 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 4, 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4219, 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-19T04:32:38.969 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 12.754981857000001, 2024-01-19T04:32:38.970 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 20, 2024-01-19T04:32:38.970 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 31, 2024-01-19T04:32:38.970 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 28, 2024-01-19T04:32:38.970 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 86.950734287000003 2024-01-19T04:32:38.970 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:32:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a980664f0 msgr2=0x7f1a980689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1abea2c640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a980664f0 0x7f1a980689b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1aa005ce00 tx=0x7f1aa0051370 comp rx=0 tx=0).stop 2024-01-19T04:32:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 msgr2=0x7f1ab806ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.965+0000 7f1abea2c640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab806ef20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000b3f0 tx=0x7f1aa000b8b0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 shutdown_connections 2024-01-19T04:32:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1a980664f0 0x7f1a980689b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80cba20 0x7f1ab814ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab8071ab0 0x7f1ab806ef20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 --2- 172.21.15.133:0/3329703325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab80716d0 0x7f1ab81f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 >> 172.21.15.133:0/3329703325 conn(0x7f1ab8066a60 msgr2=0x7f1ab80c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 shutdown_connections 2024-01-19T04:32:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:38.969+0000 7f1abea2c640 1 -- 172.21.15.133:0/3329703325 wait complete. 2024-01-19T04:32:38.991 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-19T04:32:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 Processor -- start 2024-01-19T04:32:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 -- start start 2024-01-19T04:32:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9080cf660 0x7fe9080c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe90815da50 0x7fe908159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90815a2b0 con 0x7fe9080cf280 2024-01-19T04:32:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90815d630 con 0x7fe90815da50 2024-01-19T04:32:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90fce0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90815a590 con 0x7fe9080cf660 2024-01-19T04:32:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.117+0000 7fe90e27d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe90815da50 0x7fe908159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90e27d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe90815da50 0x7fe908159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50294/0 (socket says 172.21.15.133:50294) 2024-01-19T04:32:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90e27d640 1 -- 172.21.15.133:0/2809959718 learned_addr learned my addr 172.21.15.133:0/2809959718 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90d27b640 1 --2- 172.21.15.133:0/2809959718 >> v2:172.21.15.156:3300/0 conn(0x7fe9080cf660 0x7fe9080c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90e27d640 1 -- 172.21.15.133:0/2809959718 >> v2:172.21.15.156:3300/0 conn(0x7fe9080cf660 msgr2=0x7fe9080c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2809959718 >> v2:172.21.15.156:3300/0 conn(0x7fe9080cf660 0x7fe9080c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90e27d640 1 -- 172.21.15.133:0/2809959718 >> v1:172.21.15.133:6789/0 conn(0x7fe9080cf280 legacy=0x7fe9080c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.121+0000 7fe90e27d640 1 -- 172.21.15.133:0/2809959718 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90815cf70 con 0x7fe90815da50 2024-01-19T04:32:39.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.125+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2809959718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90815da50 0x7fe908159800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe900009870 tx=0x7fe90001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455bf03b98833171 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90ca7a640 1 -- 172.21.15.133:0/2809959718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000ab610 con 0x7fe90815da50 2024-01-19T04:32:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90ca7a640 1 -- 172.21.15.133:0/2809959718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000ab770 con 0x7fe90815da50 2024-01-19T04:32:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90ca7a640 1 -- 172.21.15.133:0/2809959718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000abb00 con 0x7fe90815da50 2024-01-19T04:32:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 -- 172.21.15.133:0/2809959718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90815da50 msgr2=0x7fe908159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 --2- 172.21.15.133:0/2809959718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90815da50 0x7fe908159800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe900009870 tx=0x7fe90001c500 comp rx=0 tx=0).stop 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 -- 172.21.15.133:0/2809959718 shutdown_connections 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 --2- 172.21.15.133:0/2809959718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90815da50 0x7fe908159800 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 --2- 172.21.15.133:0/2809959718 >> v2:172.21.15.156:3300/0 conn(0x7fe9080cf660 0x7fe9080c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 -- 172.21.15.133:0/2809959718 >> 172.21.15.133:0/2809959718 conn(0x7fe90808afa0 msgr2=0x7fe90808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 -- 172.21.15.133:0/2809959718 shutdown_connections 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.133+0000 7fe90fce0640 1 -- 172.21.15.133:0/2809959718 wait complete. 2024-01-19T04:32:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 Processor -- start 2024-01-19T04:32:39.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 -- start start 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9080cf280 0x7fe908141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 0x7fe9081585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe90815da50 0x7fe908158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b3b00 con 0x7fe9080cf660 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b4e80 con 0x7fe9080cf280 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90fce0640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9081f6630 con 0x7fe90815da50 2024-01-19T04:32:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90d27b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 0x7fe9081585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90d27b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 0x7fe9081585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50298/0 (socket says 172.21.15.133:50298) 2024-01-19T04:32:39.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90d27b640 1 -- 172.21.15.133:0/1589942944 learned_addr learned my addr 172.21.15.133:0/1589942944 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90da7c640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9080cf280 0x7fe908141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.137+0000 7fe90e27d640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe90815da50 0x7fe908158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.141+0000 7fe90d27b640 1 -- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe90815da50 msgr2=0x7fe908158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.141+0000 7fe90d27b640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe90815da50 0x7fe908158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.141+0000 7fe90d27b640 1 -- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9080cf280 msgr2=0x7fe908141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.141+0000 7fe90d27b640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9080cf280 0x7fe908141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.141+0000 7fe90d27b640 1 -- 172.21.15.133:0/1589942944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000094d0 con 0x7fe9080cf660 2024-01-19T04:32:39.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.145+0000 7fe90d27b640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 0x7fe9081585b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00d800 tx=0x7fe8fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.149+0000 7fe9067fc640 1 -- 172.21.15.133:0/1589942944 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00b6c0 con 0x7fe9080cf660 2024-01-19T04:32:39.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.149+0000 7fe9067fc640 1 -- 172.21.15.133:0/1589942944 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00b820 con 0x7fe9080cf660 2024-01-19T04:32:39.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.149+0000 7fe9067fc640 1 -- 172.21.15.133:0/1589942944 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00bb90 con 0x7fe9080cf660 2024-01-19T04:32:39.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.149+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080b3d10 con 0x7fe9080cf660 2024-01-19T04:32:39.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.149+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9080b3890 con 0x7fe9080cf660 2024-01-19T04:32:39.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 Processor -- start 2024-01-19T04:32:39.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 -- start start 2024-01-19T04:32:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa39b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa747d0 0x55fb9fa74bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f88fd70 con 0x55fb9fa747d0 2024-01-19T04:32:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f88bba0 con 0x55fb9fa39730 2024-01-19T04:32:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.153+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f8890d0 con 0x55fb9fa750f0 2024-01-19T04:32:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.157+0000 7fe90e27d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa39b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.157+0000 7fe90e27d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa39b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:41856/0 (socket says 172.21.15.133:41856) 2024-01-19T04:32:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.157+0000 7fe90e27d640 1 -- 172.21.15.133:0/663252806 learned_addr learned my addr 172.21.15.133:0/663252806 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90d27b640 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90da7c640 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa747d0 0x55fb9fa74bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90e27d640 1 -- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 msgr2=0x55fb9fa7fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90e27d640 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90e27d640 1 -- 172.21.15.133:0/663252806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa747d0 msgr2=0x55fb9fa74bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90e27d640 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa747d0 0x55fb9fa74bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.161+0000 7fe90e27d640 1 -- 172.21.15.133:0/663252806 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9f57b890 con 0x55fb9fa39730 2024-01-19T04:32:39.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.173+0000 7fe90e27d640 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa39b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe90001a130 tx=0x7fe9000a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa93626eba04b55 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.177+0000 7fe8ef7fe640 1 -- 172.21.15.133:0/663252806 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000ab9a0 con 0x55fb9fa39730 2024-01-19T04:32:39.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.181+0000 7fe8ef7fe640 1 -- 172.21.15.133:0/663252806 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000abb00 con 0x55fb9fa39730 2024-01-19T04:32:39.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.181+0000 7fe8ef7fe640 1 -- 172.21.15.133:0/663252806 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000abe70 con 0x55fb9fa39730 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 msgr2=0x55fb9fa39b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa39b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe90001a130 tx=0x7fe9000a7000 comp rx=0 tx=0).stop 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- 172.21.15.133:0/663252806 shutdown_connections 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa747d0 0x55fb9fa74bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- 172.21.15.133:0/663252806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa39b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- 172.21.15.133:0/663252806 >> 172.21.15.133:0/663252806 conn(0x55fb9fa70580 msgr2=0x55fb9fa72970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- 172.21.15.133:0/663252806 shutdown_connections 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- 172.21.15.133:0/663252806 wait complete. 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- start start 2024-01-19T04:32:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 Processor -- start 2024-01-19T04:32:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa39730 0x55fb9fa6ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa747d0 0x55fb9fa6f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f8849c0 con 0x55fb9fa39730 2024-01-19T04:32:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f83c040 con 0x55fb9fa747d0 2024-01-19T04:32:39.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f841ee0 con 0x55fb9fa750f0 2024-01-19T04:32:39.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.185+0000 7fe912e3d000 10 client.0 _ll_register_callbacks cb 0x55fb9f83f1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:39.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.189+0000 7fe90d27b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.189+0000 7fe90da7c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa747d0 0x55fb9fa6f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.189+0000 7fe9067fc640 1 -- 172.21.15.133:0/1589942944 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe8fc00bcf0 con 0x7fe9080cf660 2024-01-19T04:32:39.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.189+0000 7fe90d27b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:44008/0 (socket says 172.21.15.133:44008) 2024-01-19T04:32:39.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.189+0000 7fe90d27b640 1 -- 172.21.15.133:0/2506072313 learned_addr learned my addr 172.21.15.133:0/2506072313 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.193+0000 7fe9067fc640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe8f40664f0 0x7fe8f40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.193+0000 7fe90e27d640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe8f40664f0 0x7fe8f40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.193+0000 7fe90e27d640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe8f40664f0 0x7fe8f40689b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55fb9f930620 tx=0x7fe900004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.193+0000 7fe9067fc640 1 -- 172.21.15.133:0/1589942944 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe8fc058c20 con 0x7fe9080cf660 2024-01-19T04:32:39.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.197+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa39730 0x55fb9fa6ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe90e27d640 1 -- 172.21.15.133:0/2506072313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 msgr2=0x55fb9fa7b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe90e27d640 1 -- 172.21.15.133:0/2506072313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa747d0 msgr2=0x55fb9fa6f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa747d0 0x55fb9fa6f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe90e27d640 1 -- 172.21.15.133:0/2506072313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90815cf70 con 0x55fb9fa39730 2024-01-19T04:32:39.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa39730 0x55fb9fa6ed00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe900019110 tx=0x7fe900008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85892a1e4a35db30 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.201+0000 7fe8ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.205+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2506072313 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000d5070 con 0x55fb9fa39730 2024-01-19T04:32:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.205+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2506072313 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9000cc070 con 0x55fb9fa39730 2024-01-19T04:32:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.205+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb9f80ae30 con 0x55fb9fa39730 2024-01-19T04:32:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.209+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2506072313 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9000c7620 con 0x55fb9fa39730 2024-01-19T04:32:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.209+0000 7fe912e3d000 10 client.4692 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.209+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55fb9f8445e0 con 0x55fb9fa39730 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2506072313 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb9f80ae30 con 0x55fb9fa39730 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2506072313 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe9000c7780 con 0x55fb9fa39730 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe912e3d000 10 client.4692 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe912e3d000 10 client.4692 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe912e3d000 20 client.4692 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fa7c600 0x55fb9fa7c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe912e3d000 4 client.4692 mds_command: new command op to 4224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:32:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.213+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 --> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb9f841870 con 0x55fb9fa7c600 2024-01-19T04:32:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.221+0000 7fe90da7c640 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fa7c600 0x55fb9fa7c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.325+0000 7fe8ecff9640 10 client.4692 ms_handle_connect on v2:172.21.15.133:6832/383272692 2024-01-19T04:32:39.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.325+0000 7fe90da7c640 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fa7c600 0x55fb9fa7c9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=68b280041b1cc0cb server_cookie=e1d9ed154d5400df in_seq=0 out_seq=0 2024-01-19T04:32:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2506072313 <== mds.3 v2:172.21.15.133:6832/383272692 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fb9f841870 con 0x55fb9fa7c600 2024-01-19T04:32:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe8ecff9640 10 client.4692 handle_command_reply: tid=0 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 client.4692 shutdown 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa39730 msgr2=0x55fb9fa6ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa39730 0x55fb9fa6ed00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe900019110 tx=0x7fe900008040 comp rx=0 tx=0).stop 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 shutdown_connections 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fa7c600 0x55fb9fa7c9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa747d0 0x55fb9fa6f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa750f0 0x55fb9fa7b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe8ecff9640 0 client.4692 ms_handle_reset on v2:172.21.15.133:6832/383272692 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2506072313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa39730 0x55fb9fa6ed00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 >> 172.21.15.133:0/2506072313 conn(0x55fb9fa70580 msgr2=0x55fb9fa6fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 shutdown_connections 2024-01-19T04:32:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 1 -- 172.21.15.133:0/2506072313 wait complete. 2024-01-19T04:32:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.509+0000 7fe912e3d000 20 client.4692 trim_cache size 0 max 16384 2024-01-19T04:32:39.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.561+0000 7fe912e3d000 1 Processor -- start 2024-01-19T04:32:39.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.561+0000 7fe912e3d000 1 -- start start 2024-01-19T04:32:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa7de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa7e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa87460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe912e3d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f53c940 con 0x55fb9fa750f0 2024-01-19T04:32:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f81ecf0 con 0x55fb9fa39730 2024-01-19T04:32:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f846720 con 0x55fb9fa747d0 2024-01-19T04:32:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe90e27d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa87460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe90e27d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa87460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50322/0 (socket says 172.21.15.133:50322) 2024-01-19T04:32:39.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe90e27d640 1 -- 172.21.15.133:0/374386553 learned_addr learned my addr 172.21.15.133:0/374386553 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe90da7c640 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa7de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.565+0000 7fe90d27b640 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa7e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90e27d640 1 -- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 msgr2=0x55fb9fa7e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90e27d640 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa7e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90e27d640 1 -- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 msgr2=0x55fb9fa7de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90e27d640 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa7de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90e27d640 1 -- 172.21.15.133:0/374386553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9f82a8e0 con 0x55fb9fa750f0 2024-01-19T04:32:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90da7c640 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa7de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:32:39.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.569+0000 7fe90e27d640 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa87460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe900097ee0 tx=0x7fe9000b6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50f990ab1d55309 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe8eeffd640 1 -- 172.21.15.133:0/374386553 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000d5040 con 0x55fb9fa750f0 2024-01-19T04:32:39.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe8eeffd640 1 -- 172.21.15.133:0/374386553 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000abe30 con 0x55fb9fa750f0 2024-01-19T04:32:39.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe8eeffd640 1 -- 172.21.15.133:0/374386553 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000c7820 con 0x55fb9fa750f0 2024-01-19T04:32:39.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 -- 172.21.15.133:0/374386553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 msgr2=0x55fb9fa87460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa87460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe900097ee0 tx=0x7fe9000b6040 comp rx=0 tx=0).stop 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 -- 172.21.15.133:0/374386553 shutdown_connections 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa87460 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa7e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 --2- 172.21.15.133:0/374386553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa7de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 -- 172.21.15.133:0/374386553 >> 172.21.15.133:0/374386553 conn(0x55fb9fa70580 msgr2=0x55fb9fa73fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 -- 172.21.15.133:0/374386553 shutdown_connections 2024-01-19T04:32:39.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 -- 172.21.15.133:0/374386553 wait complete. 2024-01-19T04:32:39.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.577+0000 7fe912e3d000 1 -- start start 2024-01-19T04:32:39.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 Processor -- start 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa37f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa38460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f8889c0 con 0x55fb9fa750f0 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f83b140 con 0x55fb9fa39730 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9f88d5c0 con 0x55fb9fa747d0 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe912e3d000 10 client.0 _ll_register_callbacks cb 0x55fb9f8b1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:39.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe90e27d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa38460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe90e27d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa38460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50324/0 (socket says 172.21.15.133:50324) 2024-01-19T04:32:39.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe90e27d640 1 -- 172.21.15.133:0/2683168220 learned_addr learned my addr 172.21.15.133:0/2683168220 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe90d27b640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa37f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.581+0000 7fe90da7c640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.585+0000 7fe90e27d640 1 -- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 msgr2=0x55fb9fa37f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.585+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa37f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.585+0000 7fe90e27d640 1 -- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 msgr2=0x55fb9fa379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.585+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.585+0000 7fe90e27d640 1 -- 172.21.15.133:0/2683168220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb9f8445e0 con 0x55fb9fa750f0 2024-01-19T04:32:39.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.589+0000 7fe90e27d640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa38460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe900097ee0 tx=0x7fe90001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1b483a49dc553 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.589+0000 7fe8ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:39.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.593+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2683168220 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000e8070 con 0x55fb9fa750f0 2024-01-19T04:32:39.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.593+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2683168220 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9000d77f0 con 0x55fb9fa750f0 2024-01-19T04:32:39.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.593+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb9f8364f0 con 0x55fb9fa750f0 2024-01-19T04:32:39.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.593+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2683168220 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9000d5040 con 0x55fb9fa750f0 2024-01-19T04:32:39.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.593+0000 7fe912e3d000 10 client.4698 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:39.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.593+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55fb9f57bcc0 con 0x55fb9fa750f0 2024-01-19T04:32:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2683168220 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb9f8364f0 con 0x55fb9fa750f0 2024-01-19T04:32:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2683168220 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe9000eb020 con 0x55fb9fa750f0 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe912e3d000 10 client.4698 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe912e3d000 10 client.4698 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe912e3d000 20 client.4698 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fadfca0 0x55fb9fae2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe912e3d000 4 client.4698 mds_command: new command op to 4224 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 --> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb9f883310 con 0x55fb9fadfca0 2024-01-19T04:32:39.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.597+0000 7fe90da7c640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fadfca0 0x55fb9fae2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.601+0000 7fe90da7c640 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fadfca0 0x55fb9fae2090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f336b72c4d9083fa server_cookie=5d8e5820e23fc31a in_seq=0 out_seq=0 2024-01-19T04:32:39.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.601+0000 7fe8ecff9640 10 client.4698 ms_handle_connect on v2:172.21.15.133:6832/383272692 2024-01-19T04:32:39.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe8ecff9640 1 -- 172.21.15.133:0/2683168220 <== mds.3 v2:172.21.15.133:6832/383272692 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fb9f883310 con 0x55fb9fadfca0 2024-01-19T04:32:39.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe8ecff9640 10 client.4698 handle_command_reply: tid=0 2024-01-19T04:32:39.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 client.4698 shutdown 2024-01-19T04:32:39.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 msgr2=0x55fb9fa38460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa38460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe900097ee0 tx=0x7fe90001ad40 comp rx=0 tx=0).stop 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 shutdown_connections 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:6832/383272692,v1:172.21.15.133:6833/383272692] conn(0x55fb9fadfca0 0x55fb9fae2090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fb9fa750f0 0x55fb9fa38460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55fb9fa747d0 0x55fb9fa37f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe8ecff9640 0 client.4698 ms_handle_reset on v2:172.21.15.133:6832/383272692 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 --2- 172.21.15.133:0/2683168220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb9fa39730 0x55fb9fa379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 >> 172.21.15.133:0/2683168220 conn(0x55fb9fa70580 msgr2=0x55fb9fa73200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 shutdown_connections 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 1 -- 172.21.15.133:0/2683168220 wait complete. 2024-01-19T04:32:39.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe912e3d000 20 client.4698 trim_cache size 0 max 16384 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "d3166d6e-d1d2-4f45-9af8-af169e4e9af8", 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 3, 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4224, 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 16.104103753, 2024-01-19T04:32:39.628 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 20, 2024-01-19T04:32:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 31, 2024-01-19T04:32:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 28, 2024-01-19T04:32:39.629 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 87.601811151999996 2024-01-19T04:32:39.629 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:32:39.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe8f40664f0 msgr2=0x7fe8f40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe8f40664f0 0x7fe8f40689b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55fb9f930620 tx=0x7fe900004740 comp rx=0 tx=0).stop 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 msgr2=0x7fe9081585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 0x7fe9081585b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00d800 tx=0x7fe8fc00dcc0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 shutdown_connections 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe8f40664f0 0x7fe8f40689b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe90815da50 0x7fe908158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9080cf660 0x7fe9081585b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 --2- 172.21.15.133:0/1589942944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9080cf280 0x7fe908141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 >> 172.21.15.133:0/1589942944 conn(0x7fe90808afa0 msgr2=0x7fe90808b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 shutdown_connections 2024-01-19T04:32:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.625+0000 7fe90fce0640 1 -- 172.21.15.133:0/1589942944 wait complete. 2024-01-19T04:32:39.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-01-19T04:32:39.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 Processor -- start 2024-01-19T04:32:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 -- start start 2024-01-19T04:32:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9690153860 0x7f96900c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f969006c5b0 0x7f96900ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f9690159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969006ca80 con 0x7f9690153860 2024-01-19T04:32:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900c3fa0 con 0x7f969006c5b0 2024-01-19T04:32:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f96965b5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c4280 con 0x7f96900728a0 2024-01-19T04:32:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f968ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9690153860 0x7f96900c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f968ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9690153860 0x7f96900c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50332/0 (socket says 172.21.15.133:50332) 2024-01-19T04:32:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.769+0000 7f968ffff640 1 -- 172.21.15.133:0/1900543236 learned_addr learned my addr 172.21.15.133:0/1900543236 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.773+0000 7f968ffff640 1 -- 172.21.15.133:0/1900543236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 msgr2=0x7f9690159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.773+0000 7f968ffff640 1 --2- 172.21.15.133:0/1900543236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f9690159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.773+0000 7f968ffff640 1 -- 172.21.15.133:0/1900543236 >> v2:172.21.15.156:3300/0 conn(0x7f969006c5b0 msgr2=0x7f96900ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.773+0000 7f968ffff640 1 --2- 172.21.15.133:0/1900543236 >> v2:172.21.15.156:3300/0 conn(0x7f969006c5b0 0x7f96900ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.773+0000 7f968ffff640 1 -- 172.21.15.133:0/1900543236 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900c4560 con 0x7f9690153860 2024-01-19T04:32:39.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.781+0000 7f968ffff640 1 --2- 172.21.15.133:0/1900543236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9690153860 0x7f96900c4d60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f969006c990 tx=0x7f968801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c5d4c9a913fa3f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f968effd640 1 -- 172.21.15.133:0/1900543236 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880af400 con 0x7f9690153860 2024-01-19T04:32:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f968effd640 1 -- 172.21.15.133:0/1900543236 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96880ab050 con 0x7f9690153860 2024-01-19T04:32:39.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f968effd640 1 -- 172.21.15.133:0/1900543236 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880af780 con 0x7f9690153860 2024-01-19T04:32:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- 172.21.15.133:0/1900543236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9690153860 msgr2=0x7f96900c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- 172.21.15.133:0/1900543236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9690153860 0x7f96900c4d60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f969006c990 tx=0x7f968801f1c0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- 172.21.15.133:0/1900543236 shutdown_connections 2024-01-19T04:32:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- 172.21.15.133:0/1900543236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f9690159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- 172.21.15.133:0/1900543236 >> v2:172.21.15.156:3300/0 conn(0x7f969006c5b0 0x7f96900ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- 172.21.15.133:0/1900543236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9690153860 0x7f96900c4d60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- 172.21.15.133:0/1900543236 >> 172.21.15.133:0/1900543236 conn(0x7f969008b600 msgr2=0x7f9690071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- 172.21.15.133:0/1900543236 shutdown_connections 2024-01-19T04:32:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- 172.21.15.133:0/1900543236 wait complete. 2024-01-19T04:32:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 Processor -- start 2024-01-19T04:32:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- start start 2024-01-19T04:32:39.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 0x7f96900ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f96901477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9690153860 0x7f9690147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c9100 con 0x7f969006c5b0 2024-01-19T04:32:39.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96901f2840 con 0x7f9690153860 2024-01-19T04:32:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.789+0000 7f96965b5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c8bb0 con 0x7f96900728a0 2024-01-19T04:32:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.793+0000 7f968ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 0x7f96900ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.793+0000 7f9694b52640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9690153860 0x7f9690147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.793+0000 7f968ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 0x7f96900ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50344/0 (socket says 172.21.15.133:50344) 2024-01-19T04:32:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.793+0000 7f968ffff640 1 -- 172.21.15.133:0/4067621413 learned_addr learned my addr 172.21.15.133:0/4067621413 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.793+0000 7f968f7fe640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f96901477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.797+0000 7f968ffff640 1 -- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 msgr2=0x7f96901477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.797+0000 7f968ffff640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f96901477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.797+0000 7f968ffff640 1 -- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9690153860 msgr2=0x7f9690147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.797+0000 7f968ffff640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9690153860 0x7f9690147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.797+0000 7f968ffff640 1 -- 172.21.15.133:0/4067621413 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688009b30 con 0x7f969006c5b0 2024-01-19T04:32:39.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.797+0000 7f968ffff640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 0x7f96900ca2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96880b2040 tx=0x7f968801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.801+0000 7f968cff9640 1 -- 172.21.15.133:0/4067621413 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880afc40 con 0x7f969006c5b0 2024-01-19T04:32:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.801+0000 7f968cff9640 1 -- 172.21.15.133:0/4067621413 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96880afdc0 con 0x7f969006c5b0 2024-01-19T04:32:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.801+0000 7f968cff9640 1 -- 172.21.15.133:0/4067621413 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880b8640 con 0x7f969006c5b0 2024-01-19T04:32:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.801+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900c8e20 con 0x7f969006c5b0 2024-01-19T04:32:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.801+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96900cfbf0 con 0x7f969006c5b0 2024-01-19T04:32:39.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 Processor -- start 2024-01-19T04:32:39.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 -- start start 2024-01-19T04:32:39.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a804b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 0x55c98a84aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a65ad70 con 0x55c98a83f7d0 2024-01-19T04:32:39.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a656ba0 con 0x55c98a804730 2024-01-19T04:32:39.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.805+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98a6540d0 con 0x55c98a8400f0 2024-01-19T04:32:39.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.809+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 0x55c98a84aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.809+0000 7f9694b52640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a804b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.809+0000 7f968ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.813+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 0x55c98a84aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:44050/0 (socket says 172.21.15.133:44050) 2024-01-19T04:32:39.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.813+0000 7f968f7fe640 1 -- 172.21.15.133:0/3343061504 learned_addr learned my addr 172.21.15.133:0/3343061504 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.817+0000 7f968f7fe640 1 -- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 msgr2=0x55c98a804b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.817+0000 7f968f7fe640 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a804b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.817+0000 7f968f7fe640 1 -- 172.21.15.133:0/3343061504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 msgr2=0x55c98a83fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.817+0000 7f968f7fe640 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.817+0000 7f968f7fe640 1 -- 172.21.15.133:0/3343061504 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c98a346890 con 0x55c98a8400f0 2024-01-19T04:32:39.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.825+0000 7f968f7fe640 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 0x55c98a84aa60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9680009970 tx=0x7f9680009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435eb554702bb1fb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.825+0000 7f968cff9640 1 -- 172.21.15.133:0/4067621413 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96880b6040 con 0x7f969006c5b0 2024-01-19T04:32:39.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.825+0000 7f968cff9640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9674066550 0x7f9674068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.825+0000 7f9694b52640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9674066550 0x7f9674068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.825+0000 7f9694b52640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9674066550 0x7f9674068a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9678006fd0 tx=0x7f96780090e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.825+0000 7f968cff9640 1 -- 172.21.15.133:0/4067621413 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96880f2f60 con 0x7f969006c5b0 2024-01-19T04:32:39.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.833+0000 7f9685ffb640 1 -- 172.21.15.133:0/3343061504 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680005c30 con 0x55c98a8400f0 2024-01-19T04:32:39.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.833+0000 7f9685ffb640 1 -- 172.21.15.133:0/3343061504 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680005d90 con 0x55c98a8400f0 2024-01-19T04:32:39.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.833+0000 7f9685ffb640 1 -- 172.21.15.133:0/3343061504 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000ea90 con 0x55c98a8400f0 2024-01-19T04:32:39.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 msgr2=0x55c98a84aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:39.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 0x55c98a84aa60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9680009970 tx=0x7f9680009e30 comp rx=0 tx=0).stop 2024-01-19T04:32:39.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- 172.21.15.133:0/3343061504 shutdown_connections 2024-01-19T04:32:39.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a8400f0 0x55c98a84aa60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- 172.21.15.133:0/3343061504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a804b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- 172.21.15.133:0/3343061504 >> 172.21.15.133:0/3343061504 conn(0x55c98a83b580 msgr2=0x55c98a83d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:39.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- 172.21.15.133:0/3343061504 shutdown_connections 2024-01-19T04:32:39.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- 172.21.15.133:0/3343061504 wait complete. 2024-01-19T04:32:39.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- start start 2024-01-19T04:32:39.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 Processor -- start 2024-01-19T04:32:39.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a839d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a8400f0 0x55c98a846950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a64f9c0 con 0x55c98a83f7d0 2024-01-19T04:32:39.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a607040 con 0x55c98a8400f0 2024-01-19T04:32:39.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98a60cee0 con 0x55c98a804730 2024-01-19T04:32:39.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9699712000 10 client.0 _ll_register_callbacks cb 0x55c98a60a1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:39.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50360/0 (socket says 172.21.15.133:50360) 2024-01-19T04:32:39.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f968f7fe640 1 -- 172.21.15.133:0/3840663004 learned_addr learned my addr 172.21.15.133:0/3840663004 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:39.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.837+0000 7f9694b52640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a8400f0 0x55c98a846950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.841+0000 7f968ffff640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a839d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.841+0000 7f968f7fe640 1 -- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 msgr2=0x55c98a839d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.841+0000 7f968f7fe640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a839d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.841+0000 7f968f7fe640 1 -- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a8400f0 msgr2=0x55c98a846950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:39.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.841+0000 7f968f7fe640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a8400f0 0x55c98a846950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:39.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.841+0000 7f968f7fe640 1 -- 172.21.15.133:0/3840663004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96800095d0 con 0x55c98a83f7d0 2024-01-19T04:32:39.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.845+0000 7f968f7fe640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83a240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55c98a61a430 tx=0x7f96800046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2d3a6c67fb3a27 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:39.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.845+0000 7f967effd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.849+0000 7f967effd640 1 -- 172.21.15.133:0/3840663004 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680021070 con 0x55c98a83f7d0 2024-01-19T04:32:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.849+0000 7f967effd640 1 -- 172.21.15.133:0/3840663004 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f968000edf0 con 0x55c98a83f7d0 2024-01-19T04:32:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.849+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c98a5d5e30 con 0x55c98a83f7d0 2024-01-19T04:32:39.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.853+0000 7f967effd640 1 -- 172.21.15.133:0/3840663004 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9680006050 con 0x55c98a83f7d0 2024-01-19T04:32:39.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.853+0000 7f9699712000 10 client.4707 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:39.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.853+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55c98a60f5e0 con 0x55c98a83f7d0 2024-01-19T04:32:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f967effd640 1 -- 172.21.15.133:0/3840663004 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c98a5d5e30 con 0x55c98a83f7d0 2024-01-19T04:32:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f967effd640 1 -- 172.21.15.133:0/3840663004 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9680011070 con 0x55c98a83f7d0 2024-01-19T04:32:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f9699712000 10 client.4707 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f9699712000 10 client.4707 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-19T04:32:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f9699712000 20 client.4707 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f9699712000 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a847630 0x55c98a847a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f9699712000 4 client.4707 mds_command: new command op to 4235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:32:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 --> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c98a60c870 con 0x55c98a847630 2024-01-19T04:32:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.857+0000 7f968ffff640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a847630 0x55c98a847a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.953+0000 7f968ffff640 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a847630 0x55c98a847a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2a83f413d04987a server_cookie=c47734374a3096e9 in_seq=0 out_seq=0 2024-01-19T04:32:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:39.953+0000 7f967effd640 10 client.4707 ms_handle_connect on v2:172.21.15.156:6838/1170572203 2024-01-19T04:32:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.161+0000 7f967effd640 1 -- 172.21.15.133:0/3840663004 <== mds.2 v2:172.21.15.156:6838/1170572203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c98a60c870 con 0x55c98a847630 2024-01-19T04:32:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.161+0000 7f967effd640 10 client.4707 handle_command_reply: tid=0 2024-01-19T04:32:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 client.4707 shutdown 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 msgr2=0x55c98a83a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83a240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55c98a61a430 tx=0x7f96800046d0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 shutdown_connections 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a847630 0x55c98a847a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a8400f0 0x55c98a846950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f967effd640 0 client.4707 ms_handle_reset on v2:172.21.15.156:6838/1170572203 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a83f7d0 0x55c98a83a240 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 --2- 172.21.15.133:0/3840663004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a839d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 >> 172.21.15.133:0/3840663004 conn(0x55c98a83b580 msgr2=0x55c98a83ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 shutdown_connections 2024-01-19T04:32:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 1 -- 172.21.15.133:0/3840663004 wait complete. 2024-01-19T04:32:40.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.165+0000 7f9699712000 20 client.4707 trim_cache size 0 max 16384 2024-01-19T04:32:40.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 Processor -- start 2024-01-19T04:32:40.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 -- start start 2024-01-19T04:32:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a83eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a83f7d0 0x55c98a83f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a83d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a307940 con 0x55c98a8400f0 2024-01-19T04:32:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a64e850 con 0x55c98a804730 2024-01-19T04:32:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.209+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98a6a4e40 con 0x55c98a83f7d0 2024-01-19T04:32:40.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.213+0000 7f9694b52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a83d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.213+0000 7f9694b52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a83d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50368/0 (socket says 172.21.15.133:50368) 2024-01-19T04:32:40.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.213+0000 7f9694b52640 1 -- 172.21.15.133:0/2819964342 learned_addr learned my addr 172.21.15.133:0/2819964342 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:40.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.213+0000 7f968ffff640 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a83eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.213+0000 7f968f7fe640 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a83f7d0 0x55c98a83f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.217+0000 7f9694b52640 1 -- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a83f7d0 msgr2=0x55c98a83f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.217+0000 7f9694b52640 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a83f7d0 0x55c98a83f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.217+0000 7f9694b52640 1 -- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 msgr2=0x55c98a83eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.217+0000 7f9694b52640 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a83eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.217+0000 7f9694b52640 1 -- 172.21.15.133:0/2819964342 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c98a5f58e0 con 0x55c98a8400f0 2024-01-19T04:32:40.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.221+0000 7f9694b52640 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a83d970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9678011d50 tx=0x7f9678014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79710c25f41293b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f96857fa640 1 -- 172.21.15.133:0/2819964342 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678014bd0 con 0x55c98a8400f0 2024-01-19T04:32:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f96857fa640 1 -- 172.21.15.133:0/2819964342 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678014d30 con 0x55c98a8400f0 2024-01-19T04:32:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f96857fa640 1 -- 172.21.15.133:0/2819964342 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678023480 con 0x55c98a8400f0 2024-01-19T04:32:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 -- 172.21.15.133:0/2819964342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 msgr2=0x55c98a83d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a83d970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9678011d50 tx=0x7f9678014000 comp rx=0 tx=0).stop 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 -- 172.21.15.133:0/2819964342 shutdown_connections 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a83d970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a83f7d0 0x55c98a83f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 --2- 172.21.15.133:0/2819964342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a804730 0x55c98a83eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 -- 172.21.15.133:0/2819964342 >> 172.21.15.133:0/2819964342 conn(0x55c98a83b580 msgr2=0x55c98a849050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.233+0000 7f9699712000 1 -- 172.21.15.133:0/2819964342 shutdown_connections 2024-01-19T04:32:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.237+0000 7f9699712000 1 -- 172.21.15.133:0/2819964342 wait complete. 2024-01-19T04:32:40.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.237+0000 7f9699712000 1 -- start start 2024-01-19T04:32:40.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.237+0000 7f9699712000 1 Processor -- start 2024-01-19T04:32:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a802540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a83f7d0 0x55c98a802a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a802fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a6539c0 con 0x55c98a8400f0 2024-01-19T04:32:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98a649cc0 con 0x55c98a83f7d0 2024-01-19T04:32:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98a6583f0 con 0x55c98a804730 2024-01-19T04:32:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f9699712000 10 client.0 _ll_register_callbacks cb 0x55c98a67ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f968ffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a802540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f968ffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a802540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:44080/0 (socket says 172.21.15.133:44080) 2024-01-19T04:32:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.241+0000 7f968ffff640 1 -- 172.21.15.133:0/1415968368 learned_addr learned my addr 172.21.15.133:0/1415968368 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.245+0000 7f968f7fe640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a83f7d0 0x55c98a802a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.245+0000 7f9694b52640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a802fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.253+0000 7f968ffff640 1 -- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a83f7d0 msgr2=0x55c98a802a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.253+0000 7f968ffff640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a83f7d0 0x55c98a802a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.253+0000 7f968ffff640 1 -- 172.21.15.133:0/1415968368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 msgr2=0x55c98a802fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.253+0000 7f968ffff640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a802fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.253+0000 7f968ffff640 1 -- 172.21.15.133:0/1415968368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9678011a00 con 0x55c98a804730 2024-01-19T04:32:40.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.257+0000 7f968ffff640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a802540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9688009f10 tx=0x7f968800c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da0f893efbbf6d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.257+0000 7f967effd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3301/0 2024-01-19T04:32:40.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.265+0000 7f967effd640 1 -- 172.21.15.133:0/1415968368 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880eef70 con 0x55c98a804730 2024-01-19T04:32:40.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.265+0000 7f967effd640 1 -- 172.21.15.133:0/1415968368 <== mon.2 v2:172.21.15.156:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96880ef0d0 con 0x55c98a804730 2024-01-19T04:32:40.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.265+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c98a6014f0 con 0x55c98a804730 2024-01-19T04:32:40.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.421+0000 7f967effd640 1 -- 172.21.15.133:0/1415968368 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96880fa6d0 con 0x55c98a804730 2024-01-19T04:32:40.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.421+0000 7f9699712000 10 client.4556 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:40.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.421+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55c98a346cc0 con 0x55c98a804730 2024-01-19T04:32:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f967effd640 1 -- 172.21.15.133:0/1415968368 <== mon.2 v2:172.21.15.156:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c98a6014f0 con 0x55c98a804730 2024-01-19T04:32:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f967effd640 1 -- 172.21.15.133:0/1415968368 <== mon.2 v2:172.21.15.156:3301/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9688005d20 con 0x55c98a804730 2024-01-19T04:32:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f9699712000 10 client.4556 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f9699712000 10 client.4556 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-19T04:32:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f9699712000 20 client.4556 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f9699712000 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a8aaca0 0x55c98a8ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f9699712000 4 client.4556 mds_command: new command op to 4235 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:32:40.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.457+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 --> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c98a64e310 con 0x55c98a8aaca0 2024-01-19T04:32:40.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.461+0000 7f968f7fe640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a8aaca0 0x55c98a8ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.469+0000 7f968f7fe640 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a8aaca0 0x55c98a8ad090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2992d57b27b0547f server_cookie=d3070d7e1bf4c95f in_seq=0 out_seq=0 2024-01-19T04:32:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.469+0000 7f967effd640 10 client.4556 ms_handle_connect on v2:172.21.15.156:6838/1170572203 2024-01-19T04:32:40.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f967effd640 1 -- 172.21.15.133:0/1415968368 <== mds.2 v2:172.21.15.156:6838/1170572203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c98a64e310 con 0x55c98a8aaca0 2024-01-19T04:32:40.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f967effd640 10 client.4556 handle_command_reply: tid=0 2024-01-19T04:32:40.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 client.4556 shutdown 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 msgr2=0x55c98a802540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a802540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9688009f10 tx=0x7f968800c000 comp rx=0 tx=0).stop 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 shutdown_connections 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:6838/1170572203,v1:172.21.15.156:6839/1170572203] conn(0x55c98a8aaca0 0x55c98a8ad090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c98a83f7d0 0x55c98a802a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c98a8400f0 0x55c98a802fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 --2- 172.21.15.133:0/1415968368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c98a804730 0x55c98a802540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f967effd640 0 client.4556 ms_handle_reset on v2:172.21.15.156:6838/1170572203 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 >> 172.21.15.133:0/1415968368 conn(0x55c98a83b580 msgr2=0x55c98a847a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 shutdown_connections 2024-01-19T04:32:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 1 -- 172.21.15.133:0/1415968368 wait complete. 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f9699712000 20 client.4556 trim_cache size 0 max 16384 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "d3166d6e-d1d2-4f45-9af8-af169e4e9af8", 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4235, 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-19T04:32:40.504 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-19T04:32:40.505 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 21.280983893999998, 2024-01-19T04:32:40.505 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 20, 2024-01-19T04:32:40.505 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 31, 2024-01-19T04:32:40.505 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 28, 2024-01-19T04:32:40.505 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 88.433207334000002 2024-01-19T04:32:40.505 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9674066550 msgr2=0x7f9674068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9674066550 0x7f9674068a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9678006fd0 tx=0x7f96780090e0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 msgr2=0x7f96900ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 0x7f96900ca2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96880b2040 tx=0x7f968801bf60 comp rx=0 tx=0).stop 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 shutdown_connections 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9674066550 0x7f9674068a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9690153860 0x7f9690147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96900728a0 0x7f96901477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 --2- 172.21.15.133:0/4067621413 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f969006c5b0 0x7f96900ca2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 >> 172.21.15.133:0/4067621413 conn(0x7f969008b600 msgr2=0x7f9690152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 shutdown_connections 2024-01-19T04:32:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.501+0000 7f96965b5640 1 -- 172.21.15.133:0/4067621413 wait complete. 2024-01-19T04:32:40.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-19T04:32:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f96560640 1 Processor -- start 2024-01-19T04:32:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f96560640 1 -- start start 2024-01-19T04:32:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f96560640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 0x7f2f900c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f96560640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900c5c40 con 0x7f2f900c57d0 2024-01-19T04:32:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f96560640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f90156760 con 0x7f2f901503c0 2024-01-19T04:32:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f96560640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90157300 con 0x7f2f900c7cd0 2024-01-19T04:32:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f8f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2f900c57d0 0x7f2f90156bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33930/0 (socket says 172.21.15.133:33930) 2024-01-19T04:32:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f8f7fe640 1 -- 172.21.15.133:0/339338785 learned_addr learned my addr 172.21.15.133:0/339338785 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:40.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.669+0000 7f2f94afd640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 0x7f2f900c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.673+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702887601 0 0) 0x7f2f900c5c40 con 0x7f2f900c57d0 2024-01-19T04:32:40.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.673+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f78003530 con 0x7f2f900c57d0 2024-01-19T04:32:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274834501 0 0) 0x7f2f78003530 con 0x7f2f900c57d0 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 msgr2=0x7f2f900c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 0x7f2f900c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 >> v1:172.21.15.156:6789/0 conn(0x7f2f901503c0 legacy=0x7f2f90072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f901507a0 con 0x7f2f900c57d0 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f2f84001680 con 0x7f2f900c57d0 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 >> v1:172.21.15.133:6789/0 conn(0x7f2f900c57d0 legacy=0x7f2f90156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f78003a20 0x7f2f78003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 0x7f2f780051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90157300 con 0x7f2f780047d0 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7800bbe0 con 0x7f2f78003a20 2024-01-19T04:32:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.677+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7800bda0 con 0x7f2f900c7cd0 2024-01-19T04:32:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.681+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f78003a20 0x7f2f78003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f94afd640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 0x7f2f780051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f8f7fe640 1 -- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 msgr2=0x7f2f780051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f900c7cd0 0x7f2f780051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f8f7fe640 1 -- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f78003a20 msgr2=0x7f2f78003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f78003a20 0x7f2f78003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.685+0000 7f2f8f7fe640 1 -- 172.21.15.133:0/339338785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78003530 con 0x7f2f780047d0 2024-01-19T04:32:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.689+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f78004c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f84007fd0 tx=0x7f2f8401cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2a5d9ad02820ac server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840058e0 con 0x7f2f780047d0 2024-01-19T04:32:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84005a40 con 0x7f2f780047d0 2024-01-19T04:32:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f8effd640 1 -- 172.21.15.133:0/339338785 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84005e30 con 0x7f2f780047d0 2024-01-19T04:32:40.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f96560640 1 -- 172.21.15.133:0/339338785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 msgr2=0x7f2f78004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f96560640 1 --2- 172.21.15.133:0/339338785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f78004c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f84007fd0 tx=0x7f2f8401cb40 comp rx=0 tx=0).stop 2024-01-19T04:32:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f94afd640 1 -- 172.21.15.133:0/339338785 reap_dead start 2024-01-19T04:32:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f96560640 1 -- 172.21.15.133:0/339338785 shutdown_connections 2024-01-19T04:32:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f96560640 1 -- 172.21.15.133:0/339338785 >> 172.21.15.133:0/339338785 conn(0x7f2f9006aa60 msgr2=0x7f2f9006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f96560640 1 -- 172.21.15.133:0/339338785 shutdown_connections 2024-01-19T04:32:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.693+0000 7f2f96560640 1 -- 172.21.15.133:0/339338785 wait complete. 2024-01-19T04:32:40.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 Processor -- start 2024-01-19T04:32:40.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 -- start start 2024-01-19T04:32:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f90150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f901538e0 0x7f2f90155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f901583e0 0x7f2f90158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9014f6a0 con 0x7f2f780047d0 2024-01-19T04:32:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90157b80 con 0x7f2f901583e0 2024-01-19T04:32:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f96560640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90158da0 con 0x7f2f901538e0 2024-01-19T04:32:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f90150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f90150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50392/0 (socket says 172.21.15.133:50392) 2024-01-19T04:32:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.697+0000 7f2f8ffff640 1 -- 172.21.15.133:0/3139589891 learned_addr learned my addr 172.21.15.133:0/3139589891 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f901538e0 0x7f2f90155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f94afd640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f901583e0 0x7f2f90158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f8ffff640 1 -- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f901538e0 msgr2=0x7f2f90155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f901538e0 0x7f2f90155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f8ffff640 1 -- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f901583e0 msgr2=0x7f2f90158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f901583e0 0x7f2f90158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.701+0000 7f2f8ffff640 1 -- 172.21.15.133:0/3139589891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90152b90 con 0x7f2f780047d0 2024-01-19T04:32:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.705+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f90150de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000e900 tx=0x7f2f8000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.709+0000 7f2f8cff9640 1 -- 172.21.15.133:0/3139589891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003b90 con 0x7f2f780047d0 2024-01-19T04:32:40.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.709+0000 7f2f8cff9640 1 -- 172.21.15.133:0/3139589891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80003cf0 con 0x7f2f780047d0 2024-01-19T04:32:40.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.709+0000 7f2f8cff9640 1 -- 172.21.15.133:0/3139589891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000c9c0 con 0x7f2f780047d0 2024-01-19T04:32:40.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.709+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f90153110 con 0x7f2f780047d0 2024-01-19T04:32:40.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.709+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9014efe0 con 0x7f2f780047d0 2024-01-19T04:32:40.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 Processor -- start 2024-01-19T04:32:40.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 -- start start 2024-01-19T04:32:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17ea3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17edebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17cf9d70 con 0x560d17ea3730 2024-01-19T04:32:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17cf5ba0 con 0x560d17edf0f0 2024-01-19T04:32:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.713+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17cf30d0 con 0x560d17ede7d0 2024-01-19T04:32:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.717+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17edebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.717+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17edebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:44098/0 (socket says 172.21.15.133:44098) 2024-01-19T04:32:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.717+0000 7f2f8ffff640 1 -- 172.21.15.133:0/2922441217 learned_addr learned my addr 172.21.15.133:0/2922441217 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:40.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.721+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.725+0000 7f2f8ffff640 1 -- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 msgr2=0x560d17ee9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.725+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.725+0000 7f2f8ffff640 1 -- 172.21.15.133:0/2922441217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 msgr2=0x560d17ea3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.725+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17ea3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.725+0000 7f2f8ffff640 1 -- 172.21.15.133:0/2922441217 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d179e5890 con 0x560d17ede7d0 2024-01-19T04:32:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.729+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17edebb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f80014000 tx=0x7f2f80012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add7c2af29009318 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.733+0000 7f2f8cff9640 1 -- 172.21.15.133:0/3139589891 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2f8002f030 con 0x7f2f780047d0 2024-01-19T04:32:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.733+0000 7f2f8cff9640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2f7c066580 0x7f2f7c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.733+0000 7f2f94afd640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2f7c066580 0x7f2f7c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.733+0000 7f2f94afd640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2f7c066580 0x7f2f7c068a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f900c78a0 tx=0x7f2f88009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f8cff9640 1 -- 172.21.15.133:0/3139589891 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f800586e0 con 0x7f2f780047d0 2024-01-19T04:32:40.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f75ffb640 1 -- 172.21.15.133:0/2922441217 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80054320 con 0x560d17ede7d0 2024-01-19T04:32:40.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f75ffb640 1 -- 172.21.15.133:0/2922441217 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8002d070 con 0x560d17ede7d0 2024-01-19T04:32:40.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f75ffb640 1 -- 172.21.15.133:0/2922441217 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80057db0 con 0x560d17ede7d0 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 -- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 msgr2=0x560d17edebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17edebb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f80014000 tx=0x7f2f80012000 comp rx=0 tx=0).stop 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 -- 172.21.15.133:0/2922441217 shutdown_connections 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17edebb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 --2- 172.21.15.133:0/2922441217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17ea3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.737+0000 7f2f996bd000 1 -- 172.21.15.133:0/2922441217 >> 172.21.15.133:0/2922441217 conn(0x560d17eda580 msgr2=0x560d17edc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 -- 172.21.15.133:0/2922441217 shutdown_connections 2024-01-19T04:32:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 -- 172.21.15.133:0/2922441217 wait complete. 2024-01-19T04:32:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 -- start start 2024-01-19T04:32:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 Processor -- start 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ea3730 0x560d17ed8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17ed9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ee5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17cee9c0 con 0x560d17edf0f0 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17ca6040 con 0x560d17ea3730 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17cabee0 con 0x560d17ede7d0 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f996bd000 10 client.0 _ll_register_callbacks cb 0x560d17ca91b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f94afd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ee5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f94afd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ee5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50410/0 (socket says 172.21.15.133:50410) 2024-01-19T04:32:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f94afd640 1 -- 172.21.15.133:0/1039262521 learned_addr learned my addr 172.21.15.133:0/1039262521 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:40.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.741+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ea3730 0x560d17ed8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.745+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17ed9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.745+0000 7f2f94afd640 1 -- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 msgr2=0x560d17ed9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.745+0000 7f2f94afd640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17ed9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.745+0000 7f2f94afd640 1 -- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ea3730 msgr2=0x560d17ed8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:40.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.745+0000 7f2f94afd640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ea3730 0x560d17ed8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.745+0000 7f2f94afd640 1 -- 172.21.15.133:0/1039262521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9014efe0 con 0x560d17edf0f0 2024-01-19T04:32:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.749+0000 7f2f94afd640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ee5950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f900c8c60 tx=0x7f2f880046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7d0e14ee5e97d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.749+0000 7f2f6effd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:40.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.753+0000 7f2f6effd640 1 -- 172.21.15.133:0/1039262521 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88016e40 con 0x560d17edf0f0 2024-01-19T04:32:40.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.753+0000 7f2f6effd640 1 -- 172.21.15.133:0/1039262521 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f88023660 con 0x560d17edf0f0 2024-01-19T04:32:40.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.753+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d17c74e30 con 0x560d17edf0f0 2024-01-19T04:32:40.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.753+0000 7f2f6effd640 1 -- 172.21.15.133:0/1039262521 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f88023820 con 0x560d17edf0f0 2024-01-19T04:32:40.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.753+0000 7f2f996bd000 10 client.4722 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:40.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.753+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x560d17cae5e0 con 0x560d17edf0f0 2024-01-19T04:32:40.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f6effd640 1 -- 172.21.15.133:0/1039262521 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d17c74e30 con 0x560d17edf0f0 2024-01-19T04:32:40.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f6effd640 1 -- 172.21.15.133:0/1039262521 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f2f88023980 con 0x560d17edf0f0 2024-01-19T04:32:40.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f996bd000 10 client.4722 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:40.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f996bd000 10 client.4722 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T04:32:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f996bd000 20 client.4722 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f996bd000 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ee6630 0x560d17ee6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f996bd000 4 client.4722 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:32:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.757+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 --> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d17cab870 con 0x560d17ee6630 2024-01-19T04:32:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.761+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ee6630 0x560d17ee6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:40.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.801+0000 7f2f6effd640 10 client.4722 ms_handle_connect on v2:172.21.15.133:6834/3627758076 2024-01-19T04:32:40.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.801+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ee6630 0x560d17ee6a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d69f0ba8ecf4467d server_cookie=6d7d2c2333c663ab in_seq=0 out_seq=0 2024-01-19T04:32:40.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f6effd640 1 -- 172.21.15.133:0/1039262521 <== mds.1 v2:172.21.15.133:6834/3627758076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d17cab870 con 0x560d17ee6630 2024-01-19T04:32:40.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f6effd640 10 client.4722 handle_command_reply: tid=0 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 client.4722 shutdown 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 msgr2=0x560d17ee5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ee5950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f900c8c60 tx=0x7f2f880046d0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 shutdown_connections 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ee6630 0x560d17ee6a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ee5950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17ed9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f6effd640 0 client.4722 ms_handle_reset on v2:172.21.15.133:6834/3627758076 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 --2- 172.21.15.133:0/1039262521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ea3730 0x560d17ed8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 >> 172.21.15.133:0/1039262521 conn(0x560d17eda580 msgr2=0x560d17ed9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 shutdown_connections 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 1 -- 172.21.15.133:0/1039262521 wait complete. 2024-01-19T04:32:40.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:40.981+0000 7f2f996bd000 20 client.4722 trim_cache size 0 max 16384 2024-01-19T04:32:41.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 Processor -- start 2024-01-19T04:32:41.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 -- start start 2024-01-19T04:32:41.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17edd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17eddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d179a6940 con 0x560d17ea3730 2024-01-19T04:32:41.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d179e61b0 con 0x560d17edf0f0 2024-01-19T04:32:41.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17cf73f0 con 0x560d17ede7d0 2024-01-19T04:32:41.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17edd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17edd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50424/0 (socket says 172.21.15.133:50424) 2024-01-19T04:32:41.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.009+0000 7f2f8ffff640 1 -- 172.21.15.133:0/579438697 learned_addr learned my addr 172.21.15.133:0/579438697 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f94afd640 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17eddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f8ffff640 1 -- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 msgr2=0x560d17eddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17eddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f8ffff640 1 -- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 msgr2=0x560d17ee6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.013+0000 7f2f8ffff640 1 -- 172.21.15.133:0/579438697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d17c948e0 con 0x560d17ea3730 2024-01-19T04:32:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.017+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17edd980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f800544e0 tx=0x7f2f8005e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594594c6693ff70c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f757fa640 1 -- 172.21.15.133:0/579438697 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8005c130 con 0x560d17ea3730 2024-01-19T04:32:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f757fa640 1 -- 172.21.15.133:0/579438697 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8002d040 con 0x560d17ea3730 2024-01-19T04:32:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f757fa640 1 -- 172.21.15.133:0/579438697 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800602e0 con 0x560d17ea3730 2024-01-19T04:32:41.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- 172.21.15.133:0/579438697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 msgr2=0x560d17edd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17edd980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f800544e0 tx=0x7f2f8005e040 comp rx=0 tx=0).stop 2024-01-19T04:32:41.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- 172.21.15.133:0/579438697 shutdown_connections 2024-01-19T04:32:41.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17edf0f0 0x560d17ee6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ede7d0 0x560d17eddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- 172.21.15.133:0/579438697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17ea3730 0x560d17edd980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- 172.21.15.133:0/579438697 >> 172.21.15.133:0/579438697 conn(0x560d17eda580 msgr2=0x560d17ef0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- 172.21.15.133:0/579438697 shutdown_connections 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- 172.21.15.133:0/579438697 wait complete. 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- start start 2024-01-19T04:32:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 Processor -- start 2024-01-19T04:32:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ea3730 0x560d17ea11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ede7d0 0x560d17ea1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ea1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17ce8cc0 con 0x560d17edf0f0 2024-01-19T04:32:41.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17cb5eb0 con 0x560d17ede7d0 2024-01-19T04:32:41.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17ced850 con 0x560d17ea3730 2024-01-19T04:32:41.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.025+0000 7f2f996bd000 10 client.0 _ll_register_callbacks cb 0x560d17d1ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.029+0000 7f2f94afd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ea1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.029+0000 7f2f94afd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ea1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50432/0 (socket says 172.21.15.133:50432) 2024-01-19T04:32:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.029+0000 7f2f94afd640 1 -- 172.21.15.133:0/3780603564 learned_addr learned my addr 172.21.15.133:0/3780603564 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.029+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ea3730 0x560d17ea11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.029+0000 7f2f8f7fe640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ede7d0 0x560d17ea1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f94afd640 1 -- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ea3730 msgr2=0x560d17ea11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f94afd640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ea3730 0x560d17ea11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f94afd640 1 -- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ede7d0 msgr2=0x560d17ea1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f94afd640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ede7d0 0x560d17ea1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f94afd640 1 -- 172.21.15.133:0/3780603564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8005ce70 con 0x560d17edf0f0 2024-01-19T04:32:41.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f94afd640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ea1c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f88014ee0 tx=0x7f2f88023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedd14e94d9f5f8f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.033+0000 7f2f6effd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.037+0000 7f2f6effd640 1 -- 172.21.15.133:0/3780603564 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880238f0 con 0x560d17edf0f0 2024-01-19T04:32:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.037+0000 7f2f6effd640 1 -- 172.21.15.133:0/3780603564 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f88023a50 con 0x560d17edf0f0 2024-01-19T04:32:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.037+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d17ca04f0 con 0x560d17edf0f0 2024-01-19T04:32:41.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.041+0000 7f2f6effd640 1 -- 172.21.15.133:0/3780603564 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f88004030 con 0x560d17edf0f0 2024-01-19T04:32:41.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.041+0000 7f2f996bd000 10 client.4728 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:41.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.041+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x560d179e5cc0 con 0x560d17edf0f0 2024-01-19T04:32:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f6effd640 1 -- 172.21.15.133:0/3780603564 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d17ca04f0 con 0x560d17edf0f0 2024-01-19T04:32:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f6effd640 1 -- 172.21.15.133:0/3780603564 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f2f88004190 con 0x560d17edf0f0 2024-01-19T04:32:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f996bd000 10 client.4728 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f996bd000 10 client.4728 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T04:32:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f996bd000 20 client.4728 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f996bd000 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ea2190 0x560d17ea2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f996bd000 4 client.4728 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:32:41.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.045+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 --> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560d17ced310 con 0x560d17ea2190 2024-01-19T04:32:41.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.049+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ea2190 0x560d17ea2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.053+0000 7f2f6effd640 10 client.4728 ms_handle_connect on v2:172.21.15.133:6834/3627758076 2024-01-19T04:32:41.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.053+0000 7f2f8ffff640 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ea2190 0x560d17ea2570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3439a8d91a129298 server_cookie=92fc2bc4874c969d in_seq=0 out_seq=0 2024-01-19T04:32:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f6effd640 1 -- 172.21.15.133:0/3780603564 <== mds.1 v2:172.21.15.133:6834/3627758076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560d17ced310 con 0x560d17ea2190 2024-01-19T04:32:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f6effd640 10 client.4728 handle_command_reply: tid=0 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 client.4728 shutdown 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 msgr2=0x560d17ea1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ea1c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f88014ee0 tx=0x7f2f88023000 comp rx=0 tx=0).stop 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 shutdown_connections 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:6834/3627758076,v1:172.21.15.133:6835/3627758076] conn(0x560d17ea2190 0x560d17ea2570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560d17ede7d0 0x560d17ea1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d17edf0f0 0x560d17ea1c50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f6effd640 0 client.4728 ms_handle_reset on v2:172.21.15.133:6834/3627758076 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 --2- 172.21.15.133:0/3780603564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x560d17ea3730 0x560d17ea11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 >> 172.21.15.133:0/3780603564 conn(0x560d17eda580 msgr2=0x560d17ef11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 shutdown_connections 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 1 -- 172.21.15.133:0/3780603564 wait complete. 2024-01-19T04:32:41.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.069+0000 7f2f996bd000 20 client.4728 trim_cache size 0 max 16384 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "d3166d6e-d1d2-4f45-9af8-af169e4e9af8", 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4238, 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 29.136455430000002, 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 20, 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 31, 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 28, 2024-01-19T04:32:41.074 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 89.004804739999997 2024-01-19T04:32:41.075 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:32:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2f7c066580 msgr2=0x7f2f7c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2f7c066580 0x7f2f7c068a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f900c78a0 tx=0x7f2f88009190 comp rx=0 tx=0).stop 2024-01-19T04:32:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 msgr2=0x7f2f90150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f90150de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000e900 tx=0x7f2f8000edc0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 shutdown_connections 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2f7c066580 0x7f2f7c068a40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f901583e0 0x7f2f90158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f901538e0 0x7f2f90155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 --2- 172.21.15.133:0/3139589891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780047d0 0x7f2f90150de0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 >> 172.21.15.133:0/3139589891 conn(0x7f2f9006aa60 msgr2=0x7f2f9006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 shutdown_connections 2024-01-19T04:32:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.073+0000 7f2f96560640 1 -- 172.21.15.133:0/3139589891 wait complete. 2024-01-19T04:32:41.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-19T04:32:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 Processor -- start 2024-01-19T04:32:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 -- start start 2024-01-19T04:32:41.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9700151210 0x7f97000c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97000c8830 0x7f97000cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970015aad0 con 0x7f97001515f0 2024-01-19T04:32:41.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9700158370 con 0x7f9700151210 2024-01-19T04:32:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f9704c9a640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970015b750 con 0x7f97000c8830 2024-01-19T04:32:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.213+0000 7f96fed9d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97000c8830 0x7f97000cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9700151210 0x7f97000c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9700151210 0x7f97000c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50446/0 (socket says 172.21.15.133:50446) 2024-01-19T04:32:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 -- 172.21.15.133:0/1275938979 learned_addr learned my addr 172.21.15.133:0/1275938979 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 -- 172.21.15.133:0/1275938979 >> v2:172.21.15.156:3300/0 conn(0x7f97000c8830 msgr2=0x7f97000cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 --2- 172.21.15.133:0/1275938979 >> v2:172.21.15.156:3300/0 conn(0x7f97000c8830 0x7f97000cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 -- 172.21.15.133:0/1275938979 >> v1:172.21.15.156:6789/0 conn(0x7f97001515f0 legacy=0x7f9700071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.217+0000 7f96fe59c640 1 -- 172.21.15.133:0/1275938979 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970015adb0 con 0x7f9700151210 2024-01-19T04:32:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.225+0000 7f96fe59c640 1 --2- 172.21.15.133:0/1275938979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000c5130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97000b7430 tx=0x7f96f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19ef94ab187f26b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.225+0000 7f96fd59a640 1 -- 172.21.15.133:0/1275938979 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f40ad660 con 0x7f9700151210 2024-01-19T04:32:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f96fd59a640 1 -- 172.21.15.133:0/1275938979 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f40ad7c0 con 0x7f9700151210 2024-01-19T04:32:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f96fd59a640 1 -- 172.21.15.133:0/1275938979 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f40adb50 con 0x7f9700151210 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 -- 172.21.15.133:0/1275938979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 msgr2=0x7f97000c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 --2- 172.21.15.133:0/1275938979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000c5130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97000b7430 tx=0x7f96f401c470 comp rx=0 tx=0).stop 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 -- 172.21.15.133:0/1275938979 shutdown_connections 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 --2- 172.21.15.133:0/1275938979 >> v2:172.21.15.156:3300/0 conn(0x7f97000c8830 0x7f97000cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 --2- 172.21.15.133:0/1275938979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000c5130 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 -- 172.21.15.133:0/1275938979 >> 172.21.15.133:0/1275938979 conn(0x7f9700066a60 msgr2=0x7f970006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 -- 172.21.15.133:0/1275938979 shutdown_connections 2024-01-19T04:32:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.229+0000 7f9704c9a640 1 -- 172.21.15.133:0/1275938979 wait complete. 2024-01-19T04:32:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 Processor -- start 2024-01-19T04:32:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 -- start start 2024-01-19T04:32:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97000c8830 0x7f97001f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97001515f0 0x7f9700149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97001f1510 con 0x7f9700151210 2024-01-19T04:32:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9700148bb0 con 0x7f97001515f0 2024-01-19T04:32:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f9704c9a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97000c6a40 con 0x7f97000c8830 2024-01-19T04:32:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f96fdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f96fdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50456/0 (socket says 172.21.15.133:50456) 2024-01-19T04:32:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f96fdd9b640 1 -- 172.21.15.133:0/3806293466 learned_addr learned my addr 172.21.15.133:0/3806293466 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.233+0000 7f96fed9d640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97001515f0 0x7f9700149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.237+0000 7f96fe59c640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97000c8830 0x7f97001f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.241+0000 7f96fdd9b640 1 -- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97000c8830 msgr2=0x7f97001f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.241+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97000c8830 0x7f97001f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.241+0000 7f96fdd9b640 1 -- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97001515f0 msgr2=0x7f9700149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.241+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97001515f0 0x7f9700149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.241+0000 7f96fdd9b640 1 -- 172.21.15.133:0/3806293466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40094d0 con 0x7f9700151210 2024-01-19T04:32:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.241+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000ca180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c430 tx=0x7f96f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.245+0000 7f96eeffd640 1 -- 172.21.15.133:0/3806293466 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f00052d0 con 0x7f9700151210 2024-01-19T04:32:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.245+0000 7f96eeffd640 1 -- 172.21.15.133:0/3806293466 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f0005430 con 0x7f9700151210 2024-01-19T04:32:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.245+0000 7f96eeffd640 1 -- 172.21.15.133:0/3806293466 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0007260 con 0x7f9700151210 2024-01-19T04:32:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.245+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9700149f70 con 0x7f9700151210 2024-01-19T04:32:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.245+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970014a520 con 0x7f9700151210 2024-01-19T04:32:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.249+0000 7f9707df7000 1 Processor -- start 2024-01-19T04:32:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.249+0000 7f9707df7000 1 -- start start 2024-01-19T04:32:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.249+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 0x5652d499dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d49a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f9707df7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d49a30f0 0x5652d49a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f9707df7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d47bdd70 con 0x5652d49a30f0 2024-01-19T04:32:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d47b9ba0 con 0x5652d49a27d0 2024-01-19T04:32:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d47b70d0 con 0x5652d499d920 2024-01-19T04:32:41.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f96fed9d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 0x5652d499dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f96fed9d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 0x5652d499dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:44158/0 (socket says 172.21.15.133:44158) 2024-01-19T04:32:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.253+0000 7f96fed9d640 1 -- 172.21.15.133:0/2836949011 learned_addr learned my addr 172.21.15.133:0/2836949011 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.257+0000 7f96fe59c640 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d49a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.261+0000 7f96fed9d640 1 -- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 msgr2=0x5652d49a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.261+0000 7f96fed9d640 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d49a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.261+0000 7f96fed9d640 1 -- 172.21.15.133:0/2836949011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d49a30f0 msgr2=0x5652d49a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.261+0000 7f96fed9d640 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d49a30f0 0x5652d49a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.261+0000 7f96fed9d640 1 -- 172.21.15.133:0/2836949011 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652d44a9890 con 0x5652d499d920 2024-01-19T04:32:41.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.265+0000 7f96fed9d640 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 0x5652d499dd00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009ee0 tx=0x7f96f8003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b862b91fd16a8dd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.269+0000 7f96eeffd640 1 -- 172.21.15.133:0/3806293466 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96f00073c0 con 0x7f9700151210 2024-01-19T04:32:41.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.269+0000 7f96eeffd640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f96e0066500 0x7f96e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.269+0000 7f96fe59c640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f96e0066500 0x7f96e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.269+0000 7f96fe59c640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f96e0066500 0x7f96e00689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f96f40af000 tx=0x7f96f40a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.273+0000 7f96eeffd640 1 -- 172.21.15.133:0/3806293466 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96f0007670 con 0x7f9700151210 2024-01-19T04:32:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.273+0000 7f96dffff640 1 -- 172.21.15.133:0/2836949011 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8004800 con 0x5652d499d920 2024-01-19T04:32:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.273+0000 7f96dffff640 1 -- 172.21.15.133:0/2836949011 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f8015420 con 0x5652d499d920 2024-01-19T04:32:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.273+0000 7f96dffff640 1 -- 172.21.15.133:0/2836949011 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8015790 con 0x5652d499d920 2024-01-19T04:32:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 msgr2=0x5652d499dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 0x5652d499dd00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009ee0 tx=0x7f96f8003d70 comp rx=0 tx=0).stop 2024-01-19T04:32:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- 172.21.15.133:0/2836949011 shutdown_connections 2024-01-19T04:32:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d49a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d49a30f0 0x5652d49a34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- 172.21.15.133:0/2836949011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d499d920 0x5652d499dd00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- 172.21.15.133:0/2836949011 >> 172.21.15.133:0/2836949011 conn(0x5652d499e580 msgr2=0x5652d49a0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- 172.21.15.133:0/2836949011 shutdown_connections 2024-01-19T04:32:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- 172.21.15.133:0/2836949011 wait complete. 2024-01-19T04:32:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- start start 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 Processor -- start 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 0x5652d499cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d499d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a30f0 0x5652d49ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d47b29c0 con 0x5652d499d920 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d476a040 con 0x5652d49a27d0 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d476fee0 con 0x5652d49a30f0 2024-01-19T04:32:41.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f9707df7000 10 client.0 _ll_register_callbacks cb 0x5652d476d1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f96fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 0x5652d499cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f96fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 0x5652d499cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50472/0 (socket says 172.21.15.133:50472) 2024-01-19T04:32:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.277+0000 7f96fe59c640 1 -- 172.21.15.133:0/2568126997 learned_addr learned my addr 172.21.15.133:0/2568126997 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d499d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fed9d640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a30f0 0x5652d49ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fe59c640 1 -- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a30f0 msgr2=0x5652d49ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fe59c640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a30f0 0x5652d49ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fe59c640 1 -- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 msgr2=0x5652d499d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fe59c640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d499d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fe59c640 1 -- 172.21.15.133:0/2568126997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f8011040 con 0x5652d499d920 2024-01-19T04:32:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.281+0000 7f96fed9d640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a30f0 0x5652d49ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:32:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.285+0000 7f96fe59c640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 0x5652d499cd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96f40b0040 tx=0x7f96f401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98c6de85ed98068 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.285+0000 7f96dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.289+0000 7f96dd7fa640 1 -- 172.21.15.133:0/2568126997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f40091c0 con 0x5652d499d920 2024-01-19T04:32:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.289+0000 7f96dd7fa640 1 -- 172.21.15.133:0/2568126997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96f40c4430 con 0x5652d499d920 2024-01-19T04:32:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.289+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652d4738e30 con 0x5652d499d920 2024-01-19T04:32:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.289+0000 7f96dd7fa640 1 -- 172.21.15.133:0/2568126997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96f40c45f0 con 0x5652d499d920 2024-01-19T04:32:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.289+0000 7f9707df7000 10 client.4737 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.289+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5652d47725e0 con 0x5652d499d920 2024-01-19T04:32:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f96dd7fa640 1 -- 172.21.15.133:0/2568126997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652d4738e30 con 0x5652d499d920 2024-01-19T04:32:41.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f96dd7fa640 1 -- 172.21.15.133:0/2568126997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f96f40c4750 con 0x5652d499d920 2024-01-19T04:32:41.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f9707df7000 10 client.4737 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:41.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f9707df7000 10 client.4737 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-19T04:32:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f9707df7000 20 client.4737 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f9707df7000 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49ae520 0x5652d49ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f9707df7000 4 client.4737 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:32:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 --> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652d476f870 con 0x5652d49ae520 2024-01-19T04:32:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.293+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49ae520 0x5652d49ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.297+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49ae520 0x5652d49ae900 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f77dca72e945dc server_cookie=893906a8d8e67e81 in_seq=0 out_seq=0 2024-01-19T04:32:41.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.297+0000 7f96dd7fa640 10 client.4737 ms_handle_connect on v2:172.21.15.133:6836/3631439971 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f96dd7fa640 1 -- 172.21.15.133:0/2568126997 <== mds.0 v2:172.21.15.133:6836/3631439971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5652d476f870 con 0x5652d49ae520 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f96dd7fa640 10 client.4737 handle_command_reply: tid=0 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 client.4737 shutdown 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 msgr2=0x5652d499cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 0x5652d499cd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96f40b0040 tx=0x7f96f401acb0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 shutdown_connections 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49ae520 0x5652d49ae900 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d49a27d0 0x5652d499d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a30f0 0x5652d49ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 --2- 172.21.15.133:0/2568126997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499d920 0x5652d499cd00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f96dd7fa640 0 client.4737 ms_handle_reset on v2:172.21.15.133:6836/3631439971 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 >> 172.21.15.133:0/2568126997 conn(0x5652d499e580 msgr2=0x5652d49a0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 shutdown_connections 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 1 -- 172.21.15.133:0/2568126997 wait complete. 2024-01-19T04:32:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.321+0000 7f9707df7000 20 client.4737 trim_cache size 0 max 16384 2024-01-19T04:32:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 Processor -- start 2024-01-19T04:32:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 -- start start 2024-01-19T04:32:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d4966ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d446a940 con 0x5652d499e580 2024-01-19T04:32:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d47bb5c0 con 0x5652d499d920 2024-01-19T04:32:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d4811c90 con 0x5652d49a27d0 2024-01-19T04:32:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f96fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f96fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50488/0 (socket says 172.21.15.133:50488) 2024-01-19T04:32:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f96fe59c640 1 -- 172.21.15.133:0/1490975542 learned_addr learned my addr 172.21.15.133:0/1490975542 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f96fed9d640 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d4966ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.337+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.341+0000 7f96fe59c640 1 -- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 msgr2=0x5652d4966ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.341+0000 7f96fe59c640 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d4966ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.341+0000 7f96fe59c640 1 -- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 msgr2=0x5652d49665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.341+0000 7f96fe59c640 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.341+0000 7f96fe59c640 1 -- 172.21.15.133:0/1490975542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652d47588e0 con 0x5652d499e580 2024-01-19T04:32:41.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.341+0000 7f96fe59c640 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49c23a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96f401acf0 tx=0x7f96f40be000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b89a8de674b9ad server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.345+0000 7f96df7fe640 1 -- 172.21.15.133:0/1490975542 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f40ad5e0 con 0x5652d499e580 2024-01-19T04:32:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.345+0000 7f96df7fe640 1 -- 172.21.15.133:0/1490975542 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f40be070 con 0x5652d499e580 2024-01-19T04:32:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.345+0000 7f96df7fe640 1 -- 172.21.15.133:0/1490975542 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f40b8ea0 con 0x5652d499e580 2024-01-19T04:32:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- 172.21.15.133:0/1490975542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 msgr2=0x5652d49c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49c23a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96f401acf0 tx=0x7f96f40be000 comp rx=0 tx=0).stop 2024-01-19T04:32:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- 172.21.15.133:0/1490975542 shutdown_connections 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d4966ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- 172.21.15.133:0/1490975542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49c23a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- 172.21.15.133:0/1490975542 >> 172.21.15.133:0/1490975542 conn(0x5652d499ce90 msgr2=0x5652d4965e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- 172.21.15.133:0/1490975542 shutdown_connections 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- 172.21.15.133:0/1490975542 wait complete. 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- start start 2024-01-19T04:32:41.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 Processor -- start 2024-01-19T04:32:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d49bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d47b1850 con 0x5652d499e580 2024-01-19T04:32:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652d4807e40 con 0x5652d499d920 2024-01-19T04:32:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652d477dac0 con 0x5652d49a27d0 2024-01-19T04:32:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f9707df7000 10 client.0 _ll_register_callbacks cb 0x5652d47dfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:32:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f96fdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f96fdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50490/0 (socket says 172.21.15.133:50490) 2024-01-19T04:32:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.349+0000 7f96fdd9b640 1 -- 172.21.15.133:0/519199437 learned_addr learned my addr 172.21.15.133:0/519199437 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fe59c640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fed9d640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d49bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fdd9b640 1 -- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 msgr2=0x5652d49bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d49bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fdd9b640 1 -- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 msgr2=0x5652d49af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.353+0000 7f96fdd9b640 1 -- 172.21.15.133:0/519199437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652d47725e0 con 0x5652d499e580 2024-01-19T04:32:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.357+0000 7f96fdd9b640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49afe90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f96f0053f40 tx=0x7f96f0005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde64e59bead83ff server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.357+0000 7f96dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-19T04:32:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.361+0000 7f96dd7fa640 1 -- 172.21.15.133:0/519199437 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f005c290 con 0x5652d499e580 2024-01-19T04:32:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.361+0000 7f96dd7fa640 1 -- 172.21.15.133:0/519199437 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96f00526a0 con 0x5652d499e580 2024-01-19T04:32:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.361+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652d47644f0 con 0x5652d499e580 2024-01-19T04:32:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.365+0000 7f96dd7fa640 1 -- 172.21.15.133:0/519199437 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96f006bba0 con 0x5652d499e580 2024-01-19T04:32:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.365+0000 7f9707df7000 10 client.4743 fetch_fsmap learned FSMap version 20 2024-01-19T04:32:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.365+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5652d44a9cc0 con 0x5652d499e580 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f96dd7fa640 1 -- 172.21.15.133:0/519199437 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652d47644f0 con 0x5652d499e580 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f96dd7fa640 1 -- 172.21.15.133:0/519199437 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f96f006bd00 con 0x5652d499e580 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f9707df7000 10 client.4743 fetch_fsmap finished waiting for FSMap version 20 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f9707df7000 10 client.4743 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f9707df7000 20 client.4743 populate_metadata read hostname 'smithi133' 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f9707df7000 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49a30f0 0x5652d4a148c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f9707df7000 4 client.4743 mds_command: new command op to 4247 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 --> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5652d47b1310 con 0x5652d49a30f0 2024-01-19T04:32:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.369+0000 7f96fe59c640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49a30f0 0x5652d4a148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.373+0000 7f96fe59c640 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49a30f0 0x5652d4a148c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3edc904f899b6ae8 server_cookie=e75e5a202969750 in_seq=0 out_seq=0 2024-01-19T04:32:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.373+0000 7f96dd7fa640 10 client.4743 ms_handle_connect on v2:172.21.15.133:6836/3631439971 2024-01-19T04:32:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f96dd7fa640 1 -- 172.21.15.133:0/519199437 <== mds.0 v2:172.21.15.133:6836/3631439971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5652d47b1310 con 0x5652d49a30f0 2024-01-19T04:32:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f96dd7fa640 10 client.4743 handle_command_reply: tid=0 2024-01-19T04:32:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 client.4743 shutdown 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 msgr2=0x5652d49afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49afe90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f96f0053f40 tx=0x7f96f0005050 comp rx=0 tx=0).stop 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 shutdown_connections 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:6836/3631439971,v1:172.21.15.133:6837/3631439971] conn(0x5652d49a30f0 0x5652d4a148c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5652d49a27d0 0x5652d49bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f96dd7fa640 0 client.4743 ms_handle_reset on v2:172.21.15.133:6836/3631439971 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5652d499e580 0x5652d49afe90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 --2- 172.21.15.133:0/519199437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652d499d920 0x5652d49af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 >> 172.21.15.133:0/519199437 conn(0x5652d499ce90 msgr2=0x5652d4966930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 shutdown_connections 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 1 -- 172.21.15.133:0/519199437 wait complete. 2024-01-19T04:32:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9707df7000 20 client.4743 trim_cache size 0 max 16384 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "d3166d6e-d1d2-4f45-9af8-af169e4e9af8", 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4247, 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 67.095263579999994, 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 20, 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 31, 2024-01-19T04:32:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 28, 2024-01-19T04:32:41.380 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 86.821660601999994 2024-01-19T04:32:41.380 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f96e0066500 msgr2=0x7f96e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f96e0066500 0x7f96e00689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f96f40af000 tx=0x7f96f40a7000 comp rx=0 tx=0).stop 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 msgr2=0x7f97000ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000ca180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c430 tx=0x7f96f000c8f0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 shutdown_connections 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f96e0066500 0x7f96e00689c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97001515f0 0x7f9700149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9700151210 0x7f97000ca180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 --2- 172.21.15.133:0/3806293466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97000c8830 0x7f97001f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 >> 172.21.15.133:0/3806293466 conn(0x7f9700066a60 msgr2=0x7f9700071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 shutdown_connections 2024-01-19T04:32:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.377+0000 7f9704c9a640 1 -- 172.21.15.133:0/3806293466 wait complete. 2024-01-19T04:32:41.396 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-19T04:32:41.407 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-19T04:32:41.407 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-01-19T04:32:41.407 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-19T04:32:41.407 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-19T04:32:41.408 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:41.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:41.408 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-19T04:32:41.413 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-19T04:32:41.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:41.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-19T04:32:41.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:41.467 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-01-19T04:32:41.651 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-19T04:32:41.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:32:41.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.773+0000 7f487aa1f640 1 Processor -- start 2024-01-19T04:32:41.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.773+0000 7f487aa1f640 1 -- start start 2024-01-19T04:32:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f487aa1f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f487415a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f487aa1f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48740c16a0 0x7f48740c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f487aa1f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487406b5f0 con 0x7f487406bf70 2024-01-19T04:32:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f487aa1f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48740c2040 con 0x7f48740c16a0 2024-01-19T04:32:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f487aa1f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740c6770 con 0x7f48740c0e90 2024-01-19T04:32:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f4873fff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f487406bf70 0x7f487406aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:57164/0 (socket says 172.21.15.133:57164) 2024-01-19T04:32:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f4873fff640 1 -- 172.21.15.133:0/1900327361 learned_addr learned my addr 172.21.15.133:0/1900327361 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T04:32:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.777+0000 7f48737fe640 1 --2- 172.21.15.133:0/1900327361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f487415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.785+0000 7f48737fe640 1 -- 172.21.15.133:0/1900327361 >> v2:172.21.15.133:3300/0 conn(0x7f48740c16a0 msgr2=0x7f48740c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:32:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.785+0000 7f48737fe640 1 --2- 172.21.15.133:0/1900327361 >> v2:172.21.15.133:3300/0 conn(0x7f48740c16a0 0x7f48740c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.785+0000 7f48737fe640 1 -- 172.21.15.133:0/1900327361 >> v1:172.21.15.156:6789/0 conn(0x7f487406bf70 legacy=0x7f487406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.785+0000 7f48737fe640 1 -- 172.21.15.133:0/1900327361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740c69c0 con 0x7f48740c0e90 2024-01-19T04:32:41.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.793+0000 7f48737fe640 1 --2- 172.21.15.133:0/1900327361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f487415a150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48640097c0 tx=0x7f486401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96cc9f124c8ed913 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f4872ffd640 1 -- 172.21.15.133:0/1900327361 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640a8970 con 0x7f48740c0e90 2024-01-19T04:32:41.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f4872ffd640 1 -- 172.21.15.133:0/1900327361 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48640a8ad0 con 0x7f48740c0e90 2024-01-19T04:32:41.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f4872ffd640 1 -- 172.21.15.133:0/1900327361 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640a8e60 con 0x7f48740c0e90 2024-01-19T04:32:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f487aa1f640 1 -- 172.21.15.133:0/1900327361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 msgr2=0x7f487415a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f487aa1f640 1 --2- 172.21.15.133:0/1900327361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f487415a150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48640097c0 tx=0x7f486401ec70 comp rx=0 tx=0).stop 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f487aa1f640 1 -- 172.21.15.133:0/1900327361 shutdown_connections 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f487aa1f640 1 --2- 172.21.15.133:0/1900327361 >> v2:172.21.15.133:3300/0 conn(0x7f48740c16a0 0x7f48740c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f487aa1f640 1 --2- 172.21.15.133:0/1900327361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f487415a150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.801+0000 7f487aa1f640 1 -- 172.21.15.133:0/1900327361 >> 172.21.15.133:0/1900327361 conn(0x7f4874072450 msgr2=0x7f487406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 -- 172.21.15.133:0/1900327361 shutdown_connections 2024-01-19T04:32:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 -- 172.21.15.133:0/1900327361 wait complete. 2024-01-19T04:32:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 Processor -- start 2024-01-19T04:32:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 -- start start 2024-01-19T04:32:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f487406bf70 0x7f48740c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f48740c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 0x7f4874156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48740c58a0 con 0x7f48740c16a0 2024-01-19T04:32:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741e1ea0 con 0x7f487406bf70 2024-01-19T04:32:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f487aa1f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740c5ae0 con 0x7f48740c0e90 2024-01-19T04:32:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f4878fbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 0x7f4874156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f4878fbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 0x7f4874156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50512/0 (socket says 172.21.15.133:50512) 2024-01-19T04:32:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.805+0000 7f4878fbc640 1 -- 172.21.15.133:0/614272668 learned_addr learned my addr 172.21.15.133:0/614272668 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T04:32:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f48737fe640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f48740c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f4878fbc640 1 -- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 msgr2=0x7f48740c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f4878fbc640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f48740c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f4878fbc640 1 -- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f487406bf70 msgr2=0x7f48740c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f4878fbc640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f487406bf70 0x7f48740c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f4878fbc640 1 -- 172.21.15.133:0/614272668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009420 con 0x7f48740c16a0 2024-01-19T04:32:41.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.813+0000 7f4878fbc640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 0x7f4874156a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f486c00b970 tx=0x7f486c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.817+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c00cb40 con 0x7f48740c16a0 2024-01-19T04:32:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.817+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c00ccc0 con 0x7f48740c16a0 2024-01-19T04:32:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.817+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c014680 con 0x7f48740c16a0 2024-01-19T04:32:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.817+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48740c5da0 con 0x7f48740c16a0 2024-01-19T04:32:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.817+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48740c4880 con 0x7f48740c16a0 2024-01-19T04:32:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.821+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874074340 con 0x7f48740c16a0 2024-01-19T04:32:41.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.841+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f486c01d3b0 con 0x7f48740c16a0 2024-01-19T04:32:41.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.841+0000 7f4870ff9640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4854066550 0x7f4854068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:32:41.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.841+0000 7f4873fff640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4854066550 0x7f4854068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:32:41.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:41.841+0000 7f4873fff640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4854066550 0x7f4854068a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f485c000f70 tx=0x7f485c007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:32:42.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.121+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f486c00ce30 con 0x7f48740c16a0 2024-01-19T04:32:42.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.121+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f486c051570 con 0x7f48740c16a0 2024-01-19T04:32:42.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.325+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48740b0d80 con 0x7f48740c16a0 2024-01-19T04:32:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f4870ff9640 1 -- 172.21.15.133:0/614272668 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+88 (secure 0 0 0) 0x7f486c019070 con 0x7f48740c16a0 2024-01-19T04:32:42.338 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-19T04:32:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4854066550 msgr2=0x7f4854068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4854066550 0x7f4854068a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f485c000f70 tx=0x7f485c007a90 comp rx=0 tx=0).stop 2024-01-19T04:32:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 msgr2=0x7f4874156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:32:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 0x7f4874156a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f486c00b970 tx=0x7f486c00be30 comp rx=0 tx=0).stop 2024-01-19T04:32:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 shutdown_connections 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4854066550 0x7f4854068a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48740c16a0 0x7f4874156a30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48740c0e90 0x7f48740c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 --2- 172.21.15.133:0/614272668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f487406bf70 0x7f48740c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 >> 172.21.15.133:0/614272668 conn(0x7f4874072450 msgr2=0x7f48741581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 shutdown_connections 2024-01-19T04:32:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:42.337+0000 7f487aa1f640 1 -- 172.21.15.133:0/614272668 wait complete. 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:32:42.364 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:32:42.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.365 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:32:42.371 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42108sec preferred_lft 42108sec 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:32:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:79:c0:2c:b1 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:32:42.373 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:32:42.373 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:32:42.373 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-19T04:32:42.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-19T04:32:42.373 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:32:42.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.450 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:32:42.501 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-19T04:32:42.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.502 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-19T04:32:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:32:42.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.552 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:32:42.552 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:32:42.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:32:42.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:32:42.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:32:42.552 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:32:42.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.619 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-19T04:32:42.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.666 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-01-19T04:32:42.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.714 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:32:42.714 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:32:42.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:42.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-19T04:32:42.714 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:32:42.785 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-19T04:32:42.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.786 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:32:42.786 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:32:42.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-19T04:32:42.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-19T04:32:42.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-19T04:32:42.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-19T04:32:42.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-19T04:32:42.787 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:32:42.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:42.875 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-19T04:32:42.876 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-19T04:32:42.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-19T04:32:42.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2024-01-19T04:32:42.876 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-19T04:32:42.894 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-19T04:32:42.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:32:42.895 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:42.944 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:32:42.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:32:42.945 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:42.992 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-19T04:32:42.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:43.056 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:43.102 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:43.102 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:43.103 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:43.103 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:43.103 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:43.103 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:43.103 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:43.103 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:43.104 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:43.105 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:43.106 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:43.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:43.108 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:43.155 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-19T04:32:43.155 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-19T04:32:43.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:43.213 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:43.261 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:43.262 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:43.263 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:43.264 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:43.264 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:43.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:43.265 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:44.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:44.436 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:44.487 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:44.488 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:44.489 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:44.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:44.490 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:45.639 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:45.653 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:45.702 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:45.703 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:45.704 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:45.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:45.705 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:46.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:46.869 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:46.917 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:46.917 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:46.917 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:46.917 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:46.917 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:46.919 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:46.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:46.920 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:48.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:48.086 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:48.135 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:48.136 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:48.136 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:48.136 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:48.136 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:48.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:48.137 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:49.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:49.304 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:49.349 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:49.349 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:49.349 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:49.349 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:49.349 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:49.349 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:49.350 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:49.351 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:49.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:49.352 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:49.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[35475]: starting ceph client 2024-01-19T04:32:49.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2024-01-19T04:32:49.656+0000 68f3100 -1 init, newargv = 0x7e424f0 newargc=15 2024-01-19T04:32:50.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:50.519 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:50.565 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:50.566 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:50.567 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:50.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:50.569 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:51.595 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[35475]: starting fuse 2024-01-19T04:32:51.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2024-01-19T04:32:51.731 DEBUG:teuthology.orchestra.run.smithi133:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T04:32:51.782 INFO:teuthology.orchestra.run.smithi133.stdout:/sys 2024-01-19T04:32:51.782 INFO:teuthology.orchestra.run.smithi133.stdout:/proc 2024-01-19T04:32:51.782 INFO:teuthology.orchestra.run.smithi133.stdout:/dev 2024-01-19T04:32:51.782 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/pts 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/run 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/ 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/security 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/shm 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/run/lock 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/cgroup 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/pstore 2024-01-19T04:32:51.783 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/bpf 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/hugepages 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/dev/mqueue 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/debug 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/tracing 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/proc/fs/nfsd 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/fs/fuse/connections 2024-01-19T04:32:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:/sys/kernel/config 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/run/rpc_pipefs 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/run/user/1000 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T04:32:51.785 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns 2024-01-19T04:32:51.786 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:51.786 INFO:teuthology.orchestra.run.smithi133.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:32:51.786 INFO:teuthology.orchestra.run.smithi133.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:51.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:51.786 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2024-01-19T04:32:51.829 INFO:teuthology.orchestra.run.smithi133.stdout:45 2024-01-19T04:32:51.830 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo stdin-killer -- python3 -c ' 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> import re 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> import os 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2024-01-19T04:32:51.830 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> return f 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-19T04:32:51.831 DEBUG:teuthology.orchestra.run.smithi133:> 2024-01-19T04:32:51.832 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2024-01-19T04:32:51.832 DEBUG:teuthology.orchestra.run.smithi133:> ' 2024-01-19T04:32:51.950 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.35475.asok 2024-01-19T04:32:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T04:32:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-19T04:32:51.961 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35475.asok 2024-01-19T04:32:51.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:51.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35475.asok status 2024-01-19T04:32:52.279 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "0edf41a622739843d6b978b179ff3227b476dd9d", 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)", 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "35475", 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2024-01-19T04:32:52.280 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4749, 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4749 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2617696706 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2024-01-19T04:32:52.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2617696706 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4749 192.168.0.1:0/2617696706", 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/2617696706", 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 20, 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 31, 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2024-01-19T04:32:52.282 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T04:32:52.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:52.300 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2024-01-19T04:32:52.300 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:52.364 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2024-01-19T04:32:52.364 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:52.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:32:52.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:52.429 INFO:teuthology.run_tasks:Running task workunit... 2024-01-19T04:32:52.442 INFO:tasks.workunit:Pulling workunits from ref 0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:32:52.442 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-19T04:32:52.442 INFO:tasks.workunit:timeout=3h 2024-01-19T04:32:52.442 INFO:tasks.workunit:cleanup=True 2024-01-19T04:32:52.443 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:52.449 INFO:teuthology.orchestra.run.smithi133.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-19 04:31:34.595100837 +0000 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-19 04:31:50.937426329 +0000 2024-01-19T04:32:52.450 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-19T04:32:52.450 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-19T04:32:52.450 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-19T04:32:53.712 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:32:53.720 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-19T04:33:08.096 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:33:08.099 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '0edf41a622739843d6b978b179ff3227b476dd9d'. 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-19T04:33:37.566 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-01-19T04:33:37.567 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 0edf41a6227 Merge branch 'wip-qa-container-distros-s' of https://github.com/cbodley/ceph into wip-yuri8-testing-2024-01-18-0823 2024-01-19T04:33:37.571 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-19T04:33:37.578 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-19T04:33:37.581 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-19T04:33:37.581 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-19T04:33:38.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:33:38.222 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:33:38.464 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-19T04:33:38.533 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-19T04:33:38.582 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-19T04:33:38.583 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-19T04:33:38.583 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-19T04:33:38.630 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-19T04:33:38.633 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T04:33:38.633 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-19T04:33:38.638 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-01-19T04:33:38.639 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-01-19T04:33:38.640 DEBUG:teuthology.orchestra.run.smithi133:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0edf41a622739843d6b978b179ff3227b476dd9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-01-19T04:33:39.420 INFO:tasks.workunit.client.0.smithi133.stderr:+ dbench 1 2024-01-19T04:33:39.433 INFO:tasks.workunit.client.0.smithi133.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-19T04:33:39.433 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-01-19T04:33:39.433 INFO:tasks.workunit.client.0.smithi133.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-19T04:33:39.435 INFO:tasks.workunit.client.0.smithi133.stdout:0 of 1 processes prepared for launch 0 sec 2024-01-19T04:33:39.536 INFO:tasks.workunit.client.0.smithi133.stdout:1 of 1 processes prepared for launch 0 sec 2024-01-19T04:33:39.536 INFO:tasks.workunit.client.0.smithi133.stdout:releasing clients 2024-01-19T04:33:40.536 INFO:tasks.workunit.client.0.smithi133.stdout: 0 8 0.00 MB/sec warmup 1 sec latency 95.814 ms 2024-01-19T04:33:41.536 INFO:tasks.workunit.client.0.smithi133.stdout: 0 12 0.00 MB/sec warmup 2 sec latency 140.976 ms 2024-01-19T04:33:42.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 42 0.52 MB/sec warmup 3 sec latency 545.252 ms 2024-01-19T04:33:43.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 71 0.79 MB/sec warmup 4 sec latency 472.693 ms 2024-01-19T04:33:44.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 111 1.05 MB/sec warmup 5 sec latency 448.499 ms 2024-01-19T04:33:45.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 121 0.92 MB/sec warmup 6 sec latency 405.897 ms 2024-01-19T04:33:46.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 139 0.86 MB/sec warmup 7 sec latency 480.984 ms 2024-01-19T04:33:47.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 155 0.82 MB/sec warmup 8 sec latency 487.980 ms 2024-01-19T04:33:48.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 165 0.76 MB/sec warmup 9 sec latency 449.137 ms 2024-01-19T04:33:49.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 181 0.73 MB/sec warmup 10 sec latency 765.793 ms 2024-01-19T04:33:50.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 194 0.70 MB/sec warmup 11 sec latency 495.018 ms 2024-01-19T04:33:51.536 INFO:tasks.workunit.client.0.smithi133.stdout: 1 207 0.68 MB/sec warmup 12 sec latency 353.337 ms 2024-01-19T04:33:52.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 223 0.66 MB/sec warmup 13 sec latency 535.216 ms 2024-01-19T04:33:53.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 239 0.65 MB/sec warmup 14 sec latency 577.399 ms 2024-01-19T04:33:54.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 247 0.63 MB/sec warmup 15 sec latency 709.570 ms 2024-01-19T04:33:55.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 263 0.62 MB/sec warmup 16 sec latency 540.585 ms 2024-01-19T04:33:56.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 271 0.60 MB/sec warmup 17 sec latency 637.051 ms 2024-01-19T04:33:57.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 287 0.59 MB/sec warmup 18 sec latency 642.907 ms 2024-01-19T04:33:58.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 297 0.58 MB/sec warmup 19 sec latency 453.123 ms 2024-01-19T04:33:59.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 313 0.57 MB/sec warmup 20 sec latency 537.599 ms 2024-01-19T04:34:00.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 331 0.57 MB/sec warmup 21 sec latency 431.346 ms 2024-01-19T04:34:01.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 341 0.56 MB/sec warmup 22 sec latency 512.300 ms 2024-01-19T04:34:02.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 357 0.56 MB/sec warmup 23 sec latency 509.510 ms 2024-01-19T04:34:03.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 373 0.55 MB/sec warmup 24 sec latency 453.000 ms 2024-01-19T04:34:04.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 389 0.55 MB/sec warmup 25 sec latency 630.854 ms 2024-01-19T04:34:05.537 INFO:tasks.workunit.client.0.smithi133.stdout: 1 397 0.54 MB/sec warmup 26 sec latency 521.455 ms 2024-01-19T04:34:06.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 413 0.54 MB/sec warmup 27 sec latency 595.048 ms 2024-01-19T04:34:07.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 429 0.54 MB/sec warmup 28 sec latency 489.946 ms 2024-01-19T04:34:08.369 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:34:08.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:34:08.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 445 0.54 MB/sec warmup 29 sec latency 508.772 ms 2024-01-19T04:34:09.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 453 0.53 MB/sec warmup 30 sec latency 652.078 ms 2024-01-19T04:34:10.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 469 0.53 MB/sec warmup 31 sec latency 620.711 ms 2024-01-19T04:34:11.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 477 0.52 MB/sec warmup 32 sec latency 736.823 ms 2024-01-19T04:34:12.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 493 0.52 MB/sec warmup 33 sec latency 692.663 ms 2024-01-19T04:34:13.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 501 0.51 MB/sec warmup 34 sec latency 619.244 ms 2024-01-19T04:34:14.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 511 0.51 MB/sec warmup 35 sec latency 603.597 ms 2024-01-19T04:34:15.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 527 0.51 MB/sec warmup 36 sec latency 563.303 ms 2024-01-19T04:34:16.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 595 0.56 MB/sec warmup 37 sec latency 496.013 ms 2024-01-19T04:34:17.538 INFO:tasks.workunit.client.0.smithi133.stdout: 1 604 0.55 MB/sec warmup 38 sec latency 865.478 ms 2024-01-19T04:34:18.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 609 0.54 MB/sec warmup 39 sec latency 417.887 ms 2024-01-19T04:34:19.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 614 0.52 MB/sec warmup 40 sec latency 1056.188 ms 2024-01-19T04:34:20.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 636 0.51 MB/sec warmup 41 sec latency 1056.752 ms 2024-01-19T04:34:21.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 644 0.50 MB/sec warmup 42 sec latency 757.594 ms 2024-01-19T04:34:22.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 645 0.49 MB/sec warmup 43 sec latency 1043.604 ms 2024-01-19T04:34:23.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 652 0.48 MB/sec warmup 44 sec latency 963.272 ms 2024-01-19T04:34:24.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 653 0.47 MB/sec warmup 45 sec latency 990.366 ms 2024-01-19T04:34:25.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 655 0.46 MB/sec warmup 46 sec latency 1439.849 ms 2024-01-19T04:34:26.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 676 0.45 MB/sec warmup 47 sec latency 360.118 ms 2024-01-19T04:34:27.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 680 0.44 MB/sec warmup 48 sec latency 867.501 ms 2024-01-19T04:34:28.539 INFO:tasks.workunit.client.0.smithi133.stdout: 1 682 0.43 MB/sec warmup 49 sec latency 929.967 ms 2024-01-19T04:34:29.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 705 0.42 MB/sec warmup 50 sec latency 904.613 ms 2024-01-19T04:34:30.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 711 0.42 MB/sec warmup 51 sec latency 678.489 ms 2024-01-19T04:34:31.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 726 0.41 MB/sec warmup 52 sec latency 309.160 ms 2024-01-19T04:34:32.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 744 0.40 MB/sec warmup 53 sec latency 192.021 ms 2024-01-19T04:34:33.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 746 0.39 MB/sec warmup 54 sec latency 905.500 ms 2024-01-19T04:34:34.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 746 0.39 MB/sec warmup 55 sec latency 1202.897 ms 2024-01-19T04:34:35.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 773 0.38 MB/sec warmup 56 sec latency 1268.713 ms 2024-01-19T04:34:36.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 779 0.37 MB/sec warmup 57 sec latency 620.914 ms 2024-01-19T04:34:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 798 0.37 MB/sec warmup 58 sec latency 294.647 ms 2024-01-19T04:34:38.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 812 0.36 MB/sec warmup 59 sec latency 232.478 ms 2024-01-19T04:34:39.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:34:39.261 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:34:39.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 813 0.36 MB/sec warmup 60 sec latency 1028.646 ms 2024-01-19T04:34:40.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 817 0.35 MB/sec warmup 61 sec latency 822.330 ms 2024-01-19T04:34:41.540 INFO:tasks.workunit.client.0.smithi133.stdout: 1 818 0.35 MB/sec warmup 62 sec latency 910.323 ms 2024-01-19T04:34:42.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 825 0.34 MB/sec warmup 63 sec latency 935.371 ms 2024-01-19T04:34:43.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 853 0.34 MB/sec warmup 64 sec latency 719.354 ms 2024-01-19T04:34:44.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 854 0.33 MB/sec warmup 65 sec latency 926.679 ms 2024-01-19T04:34:45.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 861 0.33 MB/sec warmup 66 sec latency 1268.265 ms 2024-01-19T04:34:46.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 862 0.32 MB/sec warmup 67 sec latency 928.019 ms 2024-01-19T04:34:47.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 874 0.32 MB/sec warmup 68 sec latency 939.431 ms 2024-01-19T04:34:48.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 880 0.31 MB/sec warmup 69 sec latency 810.797 ms 2024-01-19T04:34:49.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 897 0.31 MB/sec warmup 70 sec latency 951.030 ms 2024-01-19T04:34:50.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 904 0.31 MB/sec warmup 71 sec latency 630.130 ms 2024-01-19T04:34:51.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 925 0.30 MB/sec warmup 72 sec latency 283.219 ms 2024-01-19T04:34:52.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 927 0.30 MB/sec warmup 73 sec latency 793.834 ms 2024-01-19T04:34:53.541 INFO:tasks.workunit.client.0.smithi133.stdout: 1 929 0.29 MB/sec warmup 74 sec latency 936.249 ms 2024-01-19T04:34:54.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 930 0.29 MB/sec warmup 75 sec latency 745.273 ms 2024-01-19T04:34:55.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 931 0.29 MB/sec warmup 76 sec latency 814.166 ms 2024-01-19T04:34:56.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 937 0.28 MB/sec warmup 77 sec latency 960.187 ms 2024-01-19T04:34:57.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 942 0.28 MB/sec warmup 78 sec latency 917.031 ms 2024-01-19T04:34:58.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 955 0.28 MB/sec warmup 79 sec latency 919.446 ms 2024-01-19T04:34:59.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 969 0.27 MB/sec warmup 80 sec latency 344.819 ms 2024-01-19T04:35:00.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 980 0.27 MB/sec warmup 81 sec latency 566.948 ms 2024-01-19T04:35:01.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 994 0.27 MB/sec warmup 82 sec latency 323.529 ms 2024-01-19T04:35:02.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1000 0.27 MB/sec warmup 83 sec latency 916.913 ms 2024-01-19T04:35:03.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1027 0.27 MB/sec warmup 84 sec latency 646.437 ms 2024-01-19T04:35:04.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1033 0.27 MB/sec warmup 85 sec latency 921.734 ms 2024-01-19T04:35:05.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1036 0.27 MB/sec warmup 86 sec latency 995.672 ms 2024-01-19T04:35:06.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1046 0.26 MB/sec warmup 87 sec latency 375.677 ms 2024-01-19T04:35:07.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1047 0.26 MB/sec warmup 88 sec latency 932.318 ms 2024-01-19T04:35:08.542 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1048 0.26 MB/sec warmup 89 sec latency 1012.963 ms 2024-01-19T04:35:09.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:35:09.309 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:35:09.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1050 0.25 MB/sec warmup 90 sec latency 1198.944 ms 2024-01-19T04:35:10.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1062 0.25 MB/sec warmup 91 sec latency 339.342 ms 2024-01-19T04:35:11.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1080 0.25 MB/sec warmup 92 sec latency 325.381 ms 2024-01-19T04:35:12.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1088 0.25 MB/sec warmup 93 sec latency 403.424 ms 2024-01-19T04:35:13.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1095 0.24 MB/sec warmup 94 sec latency 972.905 ms 2024-01-19T04:35:14.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1100 0.24 MB/sec warmup 95 sec latency 379.687 ms 2024-01-19T04:35:15.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1113 0.24 MB/sec warmup 96 sec latency 966.645 ms 2024-01-19T04:35:16.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1114 0.24 MB/sec warmup 97 sec latency 868.125 ms 2024-01-19T04:35:17.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1128 0.23 MB/sec warmup 98 sec latency 1014.589 ms 2024-01-19T04:35:18.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1139 0.23 MB/sec warmup 99 sec latency 384.925 ms 2024-01-19T04:35:19.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1156 0.23 MB/sec warmup 100 sec latency 626.930 ms 2024-01-19T04:35:20.543 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1157 0.23 MB/sec warmup 101 sec latency 684.400 ms 2024-01-19T04:35:21.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1168 0.23 MB/sec warmup 102 sec latency 1007.006 ms 2024-01-19T04:35:22.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1169 0.22 MB/sec warmup 103 sec latency 939.080 ms 2024-01-19T04:35:23.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1170 0.22 MB/sec warmup 104 sec latency 957.496 ms 2024-01-19T04:35:24.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1171 0.22 MB/sec warmup 105 sec latency 1161.206 ms 2024-01-19T04:35:25.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1177 0.22 MB/sec warmup 106 sec latency 292.081 ms 2024-01-19T04:35:26.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1189 0.22 MB/sec warmup 107 sec latency 352.393 ms 2024-01-19T04:35:27.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1204 0.21 MB/sec warmup 108 sec latency 364.481 ms 2024-01-19T04:35:28.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1207 0.21 MB/sec warmup 109 sec latency 981.322 ms 2024-01-19T04:35:29.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1221 0.21 MB/sec warmup 110 sec latency 340.807 ms 2024-01-19T04:35:30.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1233 0.21 MB/sec warmup 111 sec latency 368.204 ms 2024-01-19T04:35:31.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1246 0.21 MB/sec warmup 112 sec latency 586.887 ms 2024-01-19T04:35:32.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1248 0.20 MB/sec warmup 113 sec latency 916.944 ms 2024-01-19T04:35:33.544 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1262 0.20 MB/sec warmup 114 sec latency 938.630 ms 2024-01-19T04:35:34.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1278 0.20 MB/sec warmup 115 sec latency 300.961 ms 2024-01-19T04:35:35.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1278 0.20 MB/sec warmup 116 sec latency 1203.904 ms 2024-01-19T04:35:36.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1280 0.20 MB/sec warmup 117 sec latency 1252.747 ms 2024-01-19T04:35:37.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1281 0.20 MB/sec warmup 118 sec latency 1109.029 ms 2024-01-19T04:35:38.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1284 0.19 MB/sec warmup 119 sec latency 958.713 ms 2024-01-19T04:35:39.436 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:35:39.438 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:35:40.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1377 0.00 MB/sec execute 1 sec latency 962.245 ms 2024-01-19T04:35:41.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1380 0.00 MB/sec execute 2 sec latency 927.729 ms 2024-01-19T04:35:42.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1382 0.00 MB/sec execute 3 sec latency 894.493 ms 2024-01-19T04:35:43.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1385 0.00 MB/sec execute 4 sec latency 895.173 ms 2024-01-19T04:35:44.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1395 0.00 MB/sec execute 5 sec latency 932.611 ms 2024-01-19T04:35:45.545 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1397 0.00 MB/sec execute 6 sec latency 628.087 ms 2024-01-19T04:35:46.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1410 0.00 MB/sec execute 7 sec latency 882.456 ms 2024-01-19T04:35:47.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1417 0.00 MB/sec execute 8 sec latency 893.998 ms 2024-01-19T04:35:48.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1426 0.00 MB/sec execute 9 sec latency 960.701 ms 2024-01-19T04:35:49.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1445 0.00 MB/sec execute 10 sec latency 418.361 ms 2024-01-19T04:35:50.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1448 0.00 MB/sec execute 11 sec latency 510.386 ms 2024-01-19T04:35:51.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1461 0.00 MB/sec execute 12 sec latency 806.297 ms 2024-01-19T04:35:52.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1466 0.00 MB/sec execute 13 sec latency 288.173 ms 2024-01-19T04:35:53.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1474 0.00 MB/sec execute 14 sec latency 913.370 ms 2024-01-19T04:35:54.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1485 0.00 MB/sec execute 15 sec latency 638.079 ms 2024-01-19T04:35:55.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1486 0.00 MB/sec execute 16 sec latency 1205.584 ms 2024-01-19T04:35:56.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1490 0.00 MB/sec execute 17 sec latency 494.721 ms 2024-01-19T04:35:57.546 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1499 0.00 MB/sec execute 18 sec latency 890.426 ms 2024-01-19T04:35:58.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1510 0.00 MB/sec execute 19 sec latency 488.824 ms 2024-01-19T04:35:59.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1523 0.00 MB/sec execute 20 sec latency 405.026 ms 2024-01-19T04:36:00.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1526 0.00 MB/sec execute 21 sec latency 619.017 ms 2024-01-19T04:36:01.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1530 0.00 MB/sec execute 22 sec latency 918.216 ms 2024-01-19T04:36:02.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1551 0.00 MB/sec execute 23 sec latency 958.784 ms 2024-01-19T04:36:03.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1555 0.00 MB/sec execute 24 sec latency 448.148 ms 2024-01-19T04:36:04.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1556 0.00 MB/sec execute 25 sec latency 1193.901 ms 2024-01-19T04:36:05.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1570 0.00 MB/sec execute 26 sec latency 154.951 ms 2024-01-19T04:36:06.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1584 0.01 MB/sec execute 27 sec latency 155.704 ms 2024-01-19T04:36:07.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1589 0.01 MB/sec execute 28 sec latency 320.356 ms 2024-01-19T04:36:08.547 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1589 0.01 MB/sec execute 29 sec latency 1157.534 ms 2024-01-19T04:36:09.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1605 0.01 MB/sec execute 30 sec latency 1207.207 ms 2024-01-19T04:36:09.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:36:09.569 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:36:10.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1609 0.01 MB/sec execute 31 sec latency 803.073 ms 2024-01-19T04:36:11.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1612 0.01 MB/sec execute 32 sec latency 912.831 ms 2024-01-19T04:36:12.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1617 0.00 MB/sec execute 33 sec latency 288.610 ms 2024-01-19T04:36:13.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1625 0.00 MB/sec execute 34 sec latency 978.465 ms 2024-01-19T04:36:14.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1641 0.01 MB/sec execute 35 sec latency 550.708 ms 2024-01-19T04:36:15.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1643 0.01 MB/sec execute 36 sec latency 1220.081 ms 2024-01-19T04:36:16.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1644 0.01 MB/sec execute 37 sec latency 900.526 ms 2024-01-19T04:36:17.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1660 0.01 MB/sec execute 38 sec latency 973.995 ms 2024-01-19T04:36:18.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1686 0.01 MB/sec execute 39 sec latency 449.501 ms 2024-01-19T04:36:19.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1689 0.01 MB/sec execute 40 sec latency 693.003 ms 2024-01-19T04:36:20.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1699 0.01 MB/sec execute 41 sec latency 596.307 ms 2024-01-19T04:36:21.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1701 0.01 MB/sec execute 42 sec latency 759.139 ms 2024-01-19T04:36:22.548 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1707 0.01 MB/sec execute 43 sec latency 973.859 ms 2024-01-19T04:36:23.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1729 0.01 MB/sec execute 44 sec latency 932.412 ms 2024-01-19T04:36:24.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1768 0.01 MB/sec execute 45 sec latency 260.251 ms 2024-01-19T04:36:25.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1772 0.01 MB/sec execute 46 sec latency 490.826 ms 2024-01-19T04:36:26.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1781 0.01 MB/sec execute 47 sec latency 910.467 ms 2024-01-19T04:36:27.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1803 0.01 MB/sec execute 48 sec latency 177.033 ms 2024-01-19T04:36:28.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1806 0.01 MB/sec execute 49 sec latency 378.325 ms 2024-01-19T04:36:29.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1820 0.01 MB/sec execute 50 sec latency 1052.866 ms 2024-01-19T04:36:30.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1822 0.01 MB/sec execute 51 sec latency 508.796 ms 2024-01-19T04:36:31.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1826 0.01 MB/sec execute 52 sec latency 914.695 ms 2024-01-19T04:36:32.549 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1832 0.01 MB/sec execute 53 sec latency 904.341 ms 2024-01-19T04:36:33.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1840 0.01 MB/sec execute 54 sec latency 173.827 ms 2024-01-19T04:36:34.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1841 0.01 MB/sec execute 55 sec latency 771.228 ms 2024-01-19T04:36:35.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1855 0.01 MB/sec execute 56 sec latency 1276.483 ms 2024-01-19T04:36:36.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1858 0.01 MB/sec execute 57 sec latency 747.788 ms 2024-01-19T04:36:37.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1862 0.01 MB/sec execute 58 sec latency 924.398 ms 2024-01-19T04:36:38.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1868 0.01 MB/sec execute 59 sec latency 912.387 ms 2024-01-19T04:36:39.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1869 0.01 MB/sec execute 60 sec latency 721.837 ms 2024-01-19T04:36:39.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:36:39.618 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:36:40.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1897 0.01 MB/sec execute 61 sec latency 949.154 ms 2024-01-19T04:36:41.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1902 0.01 MB/sec execute 62 sec latency 917.141 ms 2024-01-19T04:36:42.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1903 0.01 MB/sec execute 63 sec latency 906.613 ms 2024-01-19T04:36:43.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1912 0.01 MB/sec execute 64 sec latency 933.147 ms 2024-01-19T04:36:44.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1914 0.01 MB/sec execute 65 sec latency 1046.709 ms 2024-01-19T04:36:45.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1920 0.01 MB/sec execute 66 sec latency 866.059 ms 2024-01-19T04:36:46.550 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1962 0.01 MB/sec execute 67 sec latency 907.387 ms 2024-01-19T04:36:47.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1975 0.01 MB/sec execute 68 sec latency 502.619 ms 2024-01-19T04:36:48.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1976 0.01 MB/sec execute 69 sec latency 957.809 ms 2024-01-19T04:36:49.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1997 0.01 MB/sec execute 70 sec latency 187.077 ms 2024-01-19T04:36:50.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 1998 0.01 MB/sec execute 71 sec latency 973.119 ms 2024-01-19T04:36:51.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2027 0.01 MB/sec execute 72 sec latency 138.620 ms 2024-01-19T04:36:52.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2034 0.01 MB/sec execute 73 sec latency 409.492 ms 2024-01-19T04:36:53.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2043 0.01 MB/sec execute 74 sec latency 921.279 ms 2024-01-19T04:36:54.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2051 0.01 MB/sec execute 75 sec latency 949.156 ms 2024-01-19T04:36:55.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2053 0.01 MB/sec execute 76 sec latency 897.791 ms 2024-01-19T04:36:56.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2054 0.01 MB/sec execute 77 sec latency 935.359 ms 2024-01-19T04:36:57.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2060 0.01 MB/sec execute 78 sec latency 294.295 ms 2024-01-19T04:36:58.551 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2061 0.01 MB/sec execute 79 sec latency 976.683 ms 2024-01-19T04:36:59.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2079 0.01 MB/sec execute 80 sec latency 1002.516 ms 2024-01-19T04:37:00.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2081 0.01 MB/sec execute 81 sec latency 1301.758 ms 2024-01-19T04:37:01.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2088 0.01 MB/sec execute 82 sec latency 935.053 ms 2024-01-19T04:37:02.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2093 0.01 MB/sec execute 83 sec latency 594.490 ms 2024-01-19T04:37:03.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2096 0.01 MB/sec execute 84 sec latency 930.258 ms 2024-01-19T04:37:04.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2108 0.01 MB/sec execute 85 sec latency 1027.360 ms 2024-01-19T04:37:05.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2140 0.01 MB/sec execute 86 sec latency 417.215 ms 2024-01-19T04:37:06.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2141 0.01 MB/sec execute 87 sec latency 949.241 ms 2024-01-19T04:37:07.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2146 0.01 MB/sec execute 88 sec latency 882.330 ms 2024-01-19T04:37:08.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2173 0.01 MB/sec execute 89 sec latency 945.272 ms 2024-01-19T04:37:09.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2174 0.01 MB/sec execute 90 sec latency 1067.442 ms 2024-01-19T04:37:09.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:37:09.728 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:37:10.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2175 0.01 MB/sec execute 91 sec latency 990.544 ms 2024-01-19T04:37:11.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2181 0.01 MB/sec execute 92 sec latency 1108.576 ms 2024-01-19T04:37:12.552 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2183 0.01 MB/sec execute 93 sec latency 713.804 ms 2024-01-19T04:37:13.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2199 0.01 MB/sec execute 94 sec latency 934.301 ms 2024-01-19T04:37:14.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2210 0.01 MB/sec execute 95 sec latency 344.464 ms 2024-01-19T04:37:15.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2221 0.01 MB/sec execute 96 sec latency 767.041 ms 2024-01-19T04:37:16.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2258 0.01 MB/sec execute 97 sec latency 963.382 ms 2024-01-19T04:37:17.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2290 0.02 MB/sec execute 98 sec latency 237.985 ms 2024-01-19T04:37:18.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2294 0.02 MB/sec execute 99 sec latency 859.414 ms 2024-01-19T04:37:19.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2299 0.02 MB/sec execute 100 sec latency 283.772 ms 2024-01-19T04:37:20.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2303 0.02 MB/sec execute 101 sec latency 729.659 ms 2024-01-19T04:37:21.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2306 0.02 MB/sec execute 102 sec latency 903.054 ms 2024-01-19T04:37:22.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2307 0.02 MB/sec execute 103 sec latency 1423.482 ms 2024-01-19T04:37:23.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2321 0.02 MB/sec execute 104 sec latency 1128.828 ms 2024-01-19T04:37:24.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2321 0.02 MB/sec execute 105 sec latency 1238.142 ms 2024-01-19T04:37:25.553 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2325 0.02 MB/sec execute 106 sec latency 1325.401 ms 2024-01-19T04:37:26.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2335 0.02 MB/sec execute 107 sec latency 349.573 ms 2024-01-19T04:37:27.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2336 0.02 MB/sec execute 108 sec latency 901.922 ms 2024-01-19T04:37:28.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2340 0.02 MB/sec execute 109 sec latency 668.288 ms 2024-01-19T04:37:29.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2353 0.02 MB/sec execute 110 sec latency 954.380 ms 2024-01-19T04:37:30.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2361 0.02 MB/sec execute 111 sec latency 376.953 ms 2024-01-19T04:37:31.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2362 0.02 MB/sec execute 112 sec latency 944.695 ms 2024-01-19T04:37:32.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2364 0.02 MB/sec execute 113 sec latency 1122.130 ms 2024-01-19T04:37:33.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2366 0.02 MB/sec execute 114 sec latency 975.659 ms 2024-01-19T04:37:34.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2367 0.02 MB/sec execute 115 sec latency 1157.170 ms 2024-01-19T04:37:35.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2371 0.02 MB/sec execute 116 sec latency 519.312 ms 2024-01-19T04:37:36.554 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2383 0.02 MB/sec execute 117 sec latency 986.734 ms 2024-01-19T04:37:37.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2391 0.02 MB/sec execute 118 sec latency 514.320 ms 2024-01-19T04:37:38.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2394 0.02 MB/sec execute 119 sec latency 951.525 ms 2024-01-19T04:37:39.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2400 0.02 MB/sec execute 120 sec latency 331.930 ms 2024-01-19T04:37:39.774 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:37:39.777 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:37:40.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2407 0.02 MB/sec execute 121 sec latency 609.480 ms 2024-01-19T04:37:41.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2410 0.02 MB/sec execute 122 sec latency 848.543 ms 2024-01-19T04:37:42.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2428 0.02 MB/sec execute 123 sec latency 937.507 ms 2024-01-19T04:37:43.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2431 0.02 MB/sec execute 124 sec latency 590.650 ms 2024-01-19T04:37:44.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2432 0.02 MB/sec execute 125 sec latency 1021.653 ms 2024-01-19T04:37:45.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2436 0.02 MB/sec execute 126 sec latency 1032.137 ms 2024-01-19T04:37:46.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2441 0.02 MB/sec execute 127 sec latency 414.948 ms 2024-01-19T04:37:47.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2453 0.02 MB/sec execute 128 sec latency 283.748 ms 2024-01-19T04:37:48.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2466 0.02 MB/sec execute 129 sec latency 436.626 ms 2024-01-19T04:37:49.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2470 0.02 MB/sec execute 130 sec latency 589.465 ms 2024-01-19T04:37:50.555 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2484 0.02 MB/sec execute 131 sec latency 1280.375 ms 2024-01-19T04:37:51.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2492 0.02 MB/sec execute 132 sec latency 602.221 ms 2024-01-19T04:37:52.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2492 0.02 MB/sec execute 133 sec latency 1015.050 ms 2024-01-19T04:37:53.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2494 0.02 MB/sec execute 134 sec latency 1033.502 ms 2024-01-19T04:37:54.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2501 0.02 MB/sec execute 135 sec latency 1140.052 ms 2024-01-19T04:37:55.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2506 0.02 MB/sec execute 136 sec latency 539.855 ms 2024-01-19T04:37:56.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2549 0.02 MB/sec execute 137 sec latency 952.460 ms 2024-01-19T04:37:57.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2551 0.02 MB/sec execute 138 sec latency 860.840 ms 2024-01-19T04:37:58.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2559 0.02 MB/sec execute 139 sec latency 838.727 ms 2024-01-19T04:37:59.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2560 0.02 MB/sec execute 140 sec latency 815.238 ms 2024-01-19T04:38:00.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2571 0.02 MB/sec execute 141 sec latency 1174.051 ms 2024-01-19T04:38:01.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2580 0.02 MB/sec execute 142 sec latency 395.782 ms 2024-01-19T04:38:02.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2581 0.02 MB/sec execute 143 sec latency 923.609 ms 2024-01-19T04:38:03.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2582 0.02 MB/sec execute 144 sec latency 933.726 ms 2024-01-19T04:38:04.556 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2596 0.02 MB/sec execute 145 sec latency 359.497 ms 2024-01-19T04:38:05.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2600 0.02 MB/sec execute 146 sec latency 588.788 ms 2024-01-19T04:38:06.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2603 0.02 MB/sec execute 147 sec latency 1031.964 ms 2024-01-19T04:38:07.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2609 0.02 MB/sec execute 148 sec latency 386.985 ms 2024-01-19T04:38:08.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2615 0.02 MB/sec execute 149 sec latency 811.773 ms 2024-01-19T04:38:09.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2617 0.02 MB/sec execute 150 sec latency 919.723 ms 2024-01-19T04:38:09.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:38:09.899 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:38:10.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2618 0.02 MB/sec execute 151 sec latency 1184.258 ms 2024-01-19T04:38:11.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2621 0.02 MB/sec execute 152 sec latency 860.697 ms 2024-01-19T04:38:12.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2718 0.04 MB/sec execute 153 sec latency 915.979 ms 2024-01-19T04:38:13.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2719 0.04 MB/sec execute 154 sec latency 992.846 ms 2024-01-19T04:38:14.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2745 0.04 MB/sec execute 155 sec latency 888.622 ms 2024-01-19T04:38:15.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2760 0.04 MB/sec execute 156 sec latency 933.604 ms 2024-01-19T04:38:16.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2761 0.04 MB/sec execute 157 sec latency 946.359 ms 2024-01-19T04:38:17.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2768 0.04 MB/sec execute 158 sec latency 393.327 ms 2024-01-19T04:38:18.557 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2779 0.04 MB/sec execute 159 sec latency 340.235 ms 2024-01-19T04:38:19.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2780 0.04 MB/sec execute 160 sec latency 804.269 ms 2024-01-19T04:38:20.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2798 0.04 MB/sec execute 161 sec latency 1163.384 ms 2024-01-19T04:38:21.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2872 0.04 MB/sec execute 162 sec latency 969.280 ms 2024-01-19T04:38:22.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2880 0.04 MB/sec execute 163 sec latency 1119.044 ms 2024-01-19T04:38:23.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2896 0.04 MB/sec execute 164 sec latency 442.912 ms 2024-01-19T04:38:24.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2902 0.04 MB/sec execute 165 sec latency 290.243 ms 2024-01-19T04:38:25.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2918 0.05 MB/sec execute 166 sec latency 435.189 ms 2024-01-19T04:38:26.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2931 0.04 MB/sec execute 167 sec latency 294.995 ms 2024-01-19T04:38:27.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2938 0.04 MB/sec execute 168 sec latency 536.080 ms 2024-01-19T04:38:28.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2943 0.04 MB/sec execute 169 sec latency 939.028 ms 2024-01-19T04:38:29.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2966 0.04 MB/sec execute 170 sec latency 893.861 ms 2024-01-19T04:38:30.558 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2973 0.04 MB/sec execute 171 sec latency 1252.031 ms 2024-01-19T04:38:31.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2974 0.04 MB/sec execute 172 sec latency 877.021 ms 2024-01-19T04:38:32.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2978 0.04 MB/sec execute 173 sec latency 916.332 ms 2024-01-19T04:38:33.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2990 0.04 MB/sec execute 174 sec latency 374.845 ms 2024-01-19T04:38:34.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 2994 0.04 MB/sec execute 175 sec latency 697.391 ms 2024-01-19T04:38:35.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3005 0.04 MB/sec execute 176 sec latency 1010.328 ms 2024-01-19T04:38:36.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3015 0.04 MB/sec execute 177 sec latency 595.808 ms 2024-01-19T04:38:37.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3023 0.04 MB/sec execute 178 sec latency 324.453 ms 2024-01-19T04:38:38.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3031 0.04 MB/sec execute 179 sec latency 411.688 ms 2024-01-19T04:38:39.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3167 0.05 MB/sec execute 180 sec latency 1147.489 ms 2024-01-19T04:38:40.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:38:40.005 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:38:40.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3169 0.04 MB/sec execute 181 sec latency 918.755 ms 2024-01-19T04:38:41.559 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3176 0.04 MB/sec execute 182 sec latency 272.943 ms 2024-01-19T04:38:42.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3188 0.05 MB/sec execute 183 sec latency 494.932 ms 2024-01-19T04:38:43.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3190 0.04 MB/sec execute 184 sec latency 883.557 ms 2024-01-19T04:38:44.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3209 0.04 MB/sec execute 185 sec latency 432.592 ms 2024-01-19T04:38:45.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3232 0.04 MB/sec execute 186 sec latency 729.660 ms 2024-01-19T04:38:46.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3266 0.05 MB/sec execute 187 sec latency 364.536 ms 2024-01-19T04:38:47.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3268 0.05 MB/sec execute 188 sec latency 929.331 ms 2024-01-19T04:38:48.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3271 0.05 MB/sec execute 189 sec latency 1074.574 ms 2024-01-19T04:38:49.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3280 0.05 MB/sec execute 190 sec latency 408.702 ms 2024-01-19T04:38:50.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3281 0.05 MB/sec execute 191 sec latency 1121.539 ms 2024-01-19T04:38:51.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3282 0.05 MB/sec execute 192 sec latency 904.846 ms 2024-01-19T04:38:52.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3283 0.05 MB/sec execute 193 sec latency 1158.604 ms 2024-01-19T04:38:53.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3285 0.05 MB/sec execute 194 sec latency 1015.532 ms 2024-01-19T04:38:54.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3286 0.05 MB/sec execute 195 sec latency 997.784 ms 2024-01-19T04:38:55.560 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3287 0.05 MB/sec execute 196 sec latency 1156.310 ms 2024-01-19T04:38:56.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3290 0.05 MB/sec execute 197 sec latency 971.127 ms 2024-01-19T04:38:57.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3291 0.05 MB/sec execute 198 sec latency 860.977 ms 2024-01-19T04:38:58.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3292 0.05 MB/sec execute 199 sec latency 982.045 ms 2024-01-19T04:38:59.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3293 0.05 MB/sec execute 200 sec latency 956.339 ms 2024-01-19T04:39:00.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3294 0.05 MB/sec execute 201 sec latency 1117.399 ms 2024-01-19T04:39:01.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3295 0.05 MB/sec execute 202 sec latency 957.078 ms 2024-01-19T04:39:02.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3298 0.05 MB/sec execute 203 sec latency 906.784 ms 2024-01-19T04:39:03.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3299 0.05 MB/sec execute 204 sec latency 885.962 ms 2024-01-19T04:39:04.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3303 0.05 MB/sec execute 205 sec latency 917.931 ms 2024-01-19T04:39:05.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3306 0.05 MB/sec execute 206 sec latency 965.160 ms 2024-01-19T04:39:06.561 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3307 0.05 MB/sec execute 207 sec latency 906.341 ms 2024-01-19T04:39:07.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3308 0.05 MB/sec execute 208 sec latency 873.747 ms 2024-01-19T04:39:08.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3309 0.04 MB/sec execute 209 sec latency 893.767 ms 2024-01-19T04:39:09.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3310 0.04 MB/sec execute 210 sec latency 912.230 ms 2024-01-19T04:39:10.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:39:10.134 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:39:10.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3311 0.04 MB/sec execute 211 sec latency 899.764 ms 2024-01-19T04:39:11.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3312 0.04 MB/sec execute 212 sec latency 896.379 ms 2024-01-19T04:39:12.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3313 0.04 MB/sec execute 213 sec latency 918.459 ms 2024-01-19T04:39:13.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3314 0.04 MB/sec execute 214 sec latency 923.359 ms 2024-01-19T04:39:14.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3317 0.04 MB/sec execute 215 sec latency 932.146 ms 2024-01-19T04:39:15.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3318 0.04 MB/sec execute 216 sec latency 942.490 ms 2024-01-19T04:39:16.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3319 0.04 MB/sec execute 217 sec latency 900.470 ms 2024-01-19T04:39:17.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3320 0.04 MB/sec execute 218 sec latency 921.777 ms 2024-01-19T04:39:18.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3322 0.04 MB/sec execute 219 sec latency 892.298 ms 2024-01-19T04:39:19.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3323 0.04 MB/sec execute 220 sec latency 912.679 ms 2024-01-19T04:39:20.562 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3324 0.04 MB/sec execute 221 sec latency 917.485 ms 2024-01-19T04:39:21.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3325 0.04 MB/sec execute 222 sec latency 967.826 ms 2024-01-19T04:39:22.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3326 0.04 MB/sec execute 223 sec latency 916.321 ms 2024-01-19T04:39:23.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3327 0.04 MB/sec execute 224 sec latency 929.461 ms 2024-01-19T04:39:24.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3330 0.04 MB/sec execute 225 sec latency 895.753 ms 2024-01-19T04:39:25.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3331 0.04 MB/sec execute 226 sec latency 901.989 ms 2024-01-19T04:39:26.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3332 0.04 MB/sec execute 227 sec latency 920.972 ms 2024-01-19T04:39:27.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3334 0.04 MB/sec execute 228 sec latency 928.841 ms 2024-01-19T04:39:28.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3335 0.04 MB/sec execute 229 sec latency 872.473 ms 2024-01-19T04:39:29.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3336 0.04 MB/sec execute 230 sec latency 898.887 ms 2024-01-19T04:39:30.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3337 0.04 MB/sec execute 231 sec latency 925.167 ms 2024-01-19T04:39:31.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3341 0.04 MB/sec execute 232 sec latency 900.763 ms 2024-01-19T04:39:32.563 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3352 0.04 MB/sec execute 233 sec latency 335.819 ms 2024-01-19T04:39:33.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3361 0.04 MB/sec execute 234 sec latency 362.955 ms 2024-01-19T04:39:34.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3371 0.04 MB/sec execute 235 sec latency 383.278 ms 2024-01-19T04:39:35.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3378 0.04 MB/sec execute 236 sec latency 240.121 ms 2024-01-19T04:39:36.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3391 0.04 MB/sec execute 237 sec latency 379.825 ms 2024-01-19T04:39:37.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3393 0.04 MB/sec execute 238 sec latency 959.962 ms 2024-01-19T04:39:38.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3395 0.04 MB/sec execute 239 sec latency 1172.737 ms 2024-01-19T04:39:39.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3398 0.04 MB/sec execute 240 sec latency 1008.581 ms 2024-01-19T04:39:40.394 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:39:40.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:39:40.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3398 0.04 MB/sec execute 241 sec latency 1023.945 ms 2024-01-19T04:39:41.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3494 0.05 MB/sec execute 242 sec latency 1094.097 ms 2024-01-19T04:39:42.262 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:09:29.889 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:42.418 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:09:30.045 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:42.459 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:09:30.071 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:42.463 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:30.073 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:42.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3502 0.05 MB/sec execute 243 sec latency 461.820 ms 2024-01-19T04:39:42.581 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:09:30.192 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:42.598 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:30.208 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:42.868 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:09:30.496 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:43.145 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:09:30.756 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:43.237 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:30.847 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:39:43.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3515 0.05 MB/sec execute 244 sec latency 513.647 ms 2024-01-19T04:39:44.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3531 0.05 MB/sec execute 245 sec latency 247.483 ms 2024-01-19T04:39:45.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3533 0.05 MB/sec execute 246 sec latency 917.546 ms 2024-01-19T04:39:46.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3548 0.05 MB/sec execute 247 sec latency 313.570 ms 2024-01-19T04:39:47.564 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3556 0.05 MB/sec execute 248 sec latency 426.348 ms 2024-01-19T04:39:48.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3557 0.05 MB/sec execute 249 sec latency 928.614 ms 2024-01-19T04:39:49.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3562 0.05 MB/sec execute 250 sec latency 993.103 ms 2024-01-19T04:39:50.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3573 0.05 MB/sec execute 251 sec latency 288.525 ms 2024-01-19T04:39:51.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3577 0.05 MB/sec execute 252 sec latency 985.757 ms 2024-01-19T04:39:52.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3588 0.05 MB/sec execute 253 sec latency 280.512 ms 2024-01-19T04:39:53.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3617 0.05 MB/sec execute 254 sec latency 1031.165 ms 2024-01-19T04:39:54.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3627 0.05 MB/sec execute 255 sec latency 410.096 ms 2024-01-19T04:39:55.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3636 0.05 MB/sec execute 256 sec latency 413.842 ms 2024-01-19T04:39:56.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3642 0.05 MB/sec execute 257 sec latency 400.971 ms 2024-01-19T04:39:57.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3645 0.05 MB/sec execute 258 sec latency 956.056 ms 2024-01-19T04:39:58.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3665 0.05 MB/sec execute 259 sec latency 303.769 ms 2024-01-19T04:39:59.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3672 0.05 MB/sec execute 260 sec latency 353.449 ms 2024-01-19T04:40:00.565 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3673 0.05 MB/sec execute 261 sec latency 1310.903 ms 2024-01-19T04:40:01.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3677 0.05 MB/sec execute 262 sec latency 304.159 ms 2024-01-19T04:40:02.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3686 0.05 MB/sec execute 263 sec latency 509.054 ms 2024-01-19T04:40:03.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3691 0.05 MB/sec execute 264 sec latency 992.385 ms 2024-01-19T04:40:04.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3697 0.05 MB/sec execute 265 sec latency 384.287 ms 2024-01-19T04:40:05.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3707 0.05 MB/sec execute 266 sec latency 347.347 ms 2024-01-19T04:40:06.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3720 0.05 MB/sec execute 267 sec latency 370.518 ms 2024-01-19T04:40:07.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3758 0.05 MB/sec execute 268 sec latency 168.172 ms 2024-01-19T04:40:08.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3760 0.05 MB/sec execute 269 sec latency 949.734 ms 2024-01-19T04:40:09.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3768 0.05 MB/sec execute 270 sec latency 435.067 ms 2024-01-19T04:40:10.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:40:10.518 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:40:10.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3774 0.05 MB/sec execute 271 sec latency 690.373 ms 2024-01-19T04:40:11.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3780 0.05 MB/sec execute 272 sec latency 413.876 ms 2024-01-19T04:40:12.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3787 0.05 MB/sec execute 273 sec latency 498.869 ms 2024-01-19T04:40:13.566 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3790 0.05 MB/sec execute 274 sec latency 472.254 ms 2024-01-19T04:40:14.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3792 0.05 MB/sec execute 275 sec latency 492.491 ms 2024-01-19T04:40:15.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3796 0.05 MB/sec execute 276 sec latency 737.991 ms 2024-01-19T04:40:16.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3801 0.05 MB/sec execute 277 sec latency 516.501 ms 2024-01-19T04:40:17.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3807 0.05 MB/sec execute 278 sec latency 482.136 ms 2024-01-19T04:40:18.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3813 0.05 MB/sec execute 279 sec latency 414.892 ms 2024-01-19T04:40:19.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3820 0.05 MB/sec execute 280 sec latency 299.138 ms 2024-01-19T04:40:20.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3824 0.05 MB/sec execute 281 sec latency 531.136 ms 2024-01-19T04:40:21.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3830 0.05 MB/sec execute 282 sec latency 352.549 ms 2024-01-19T04:40:22.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3837 0.05 MB/sec execute 283 sec latency 347.863 ms 2024-01-19T04:40:23.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3844 0.05 MB/sec execute 284 sec latency 268.663 ms 2024-01-19T04:40:24.413 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:10:12.041 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.445 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:10:12.073 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.450 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:12.060 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.462 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:12.072 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.465 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:10:12.076 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.487 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:10:12.099 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3848 0.05 MB/sec execute 285 sec latency 422.378 ms 2024-01-19T04:40:24.589 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:12.199 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.647 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:10:12.258 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:24.653 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:10:12.281 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:40:25.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3855 0.05 MB/sec execute 286 sec latency 311.556 ms 2024-01-19T04:40:26.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3861 0.05 MB/sec execute 287 sec latency 393.289 ms 2024-01-19T04:40:27.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3868 0.05 MB/sec execute 288 sec latency 308.350 ms 2024-01-19T04:40:28.567 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3870 0.05 MB/sec execute 289 sec latency 564.091 ms 2024-01-19T04:40:29.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3876 0.05 MB/sec execute 290 sec latency 925.209 ms 2024-01-19T04:40:30.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3878 0.05 MB/sec execute 291 sec latency 1124.546 ms 2024-01-19T04:40:31.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3884 0.05 MB/sec execute 292 sec latency 299.583 ms 2024-01-19T04:40:32.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3896 0.05 MB/sec execute 293 sec latency 411.774 ms 2024-01-19T04:40:33.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3898 0.05 MB/sec execute 294 sec latency 913.755 ms 2024-01-19T04:40:34.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3900 0.05 MB/sec execute 295 sec latency 933.423 ms 2024-01-19T04:40:35.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3914 0.05 MB/sec execute 296 sec latency 189.598 ms 2024-01-19T04:40:36.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3915 0.05 MB/sec execute 297 sec latency 858.534 ms 2024-01-19T04:40:37.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3923 0.05 MB/sec execute 298 sec latency 410.693 ms 2024-01-19T04:40:38.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3928 0.05 MB/sec execute 299 sec latency 373.925 ms 2024-01-19T04:40:39.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3936 0.05 MB/sec execute 300 sec latency 470.989 ms 2024-01-19T04:40:40.568 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3937 0.05 MB/sec execute 301 sec latency 678.099 ms 2024-01-19T04:40:40.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:40:40.760 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:40:41.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3939 0.05 MB/sec execute 302 sec latency 503.200 ms 2024-01-19T04:40:42.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3944 0.05 MB/sec execute 303 sec latency 489.782 ms 2024-01-19T04:40:43.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3951 0.05 MB/sec execute 304 sec latency 548.200 ms 2024-01-19T04:40:44.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3955 0.05 MB/sec execute 305 sec latency 373.105 ms 2024-01-19T04:40:45.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3962 0.05 MB/sec execute 306 sec latency 368.340 ms 2024-01-19T04:40:46.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3967 0.05 MB/sec execute 307 sec latency 329.526 ms 2024-01-19T04:40:47.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3975 0.05 MB/sec execute 308 sec latency 451.256 ms 2024-01-19T04:40:48.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3979 0.05 MB/sec execute 309 sec latency 393.362 ms 2024-01-19T04:40:49.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3986 0.05 MB/sec execute 310 sec latency 370.593 ms 2024-01-19T04:40:50.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3991 0.05 MB/sec execute 311 sec latency 356.048 ms 2024-01-19T04:40:51.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 3998 0.05 MB/sec execute 312 sec latency 401.700 ms 2024-01-19T04:40:52.569 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4002 0.04 MB/sec execute 313 sec latency 430.230 ms 2024-01-19T04:40:53.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4009 0.04 MB/sec execute 314 sec latency 390.797 ms 2024-01-19T04:40:54.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4015 0.04 MB/sec execute 315 sec latency 340.007 ms 2024-01-19T04:40:55.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4022 0.04 MB/sec execute 316 sec latency 273.539 ms 2024-01-19T04:40:56.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4027 0.04 MB/sec execute 317 sec latency 399.622 ms 2024-01-19T04:40:57.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4028 0.04 MB/sec execute 318 sec latency 1001.537 ms 2024-01-19T04:40:58.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4032 0.04 MB/sec execute 319 sec latency 612.227 ms 2024-01-19T04:40:59.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4035 0.04 MB/sec execute 320 sec latency 1000.912 ms 2024-01-19T04:41:00.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4036 0.04 MB/sec execute 321 sec latency 1099.510 ms 2024-01-19T04:41:01.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4042 0.04 MB/sec execute 322 sec latency 195.330 ms 2024-01-19T04:41:02.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4047 0.04 MB/sec execute 323 sec latency 351.229 ms 2024-01-19T04:41:03.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4058 0.04 MB/sec execute 324 sec latency 906.234 ms 2024-01-19T04:41:04.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4060 0.04 MB/sec execute 325 sec latency 887.522 ms 2024-01-19T04:41:05.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4064 0.04 MB/sec execute 326 sec latency 511.219 ms 2024-01-19T04:41:06.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4071 0.04 MB/sec execute 327 sec latency 196.369 ms 2024-01-19T04:41:07.570 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4082 0.04 MB/sec execute 328 sec latency 912.584 ms 2024-01-19T04:41:08.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4085 0.04 MB/sec execute 329 sec latency 889.091 ms 2024-01-19T04:41:09.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4094 0.04 MB/sec execute 330 sec latency 380.990 ms 2024-01-19T04:41:10.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4105 0.04 MB/sec execute 331 sec latency 515.030 ms 2024-01-19T04:41:10.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:41:10.806 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:41:11.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4114 0.04 MB/sec execute 332 sec latency 535.378 ms 2024-01-19T04:41:12.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4120 0.04 MB/sec execute 333 sec latency 578.268 ms 2024-01-19T04:41:13.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4130 0.04 MB/sec execute 334 sec latency 192.845 ms 2024-01-19T04:41:14.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4142 0.04 MB/sec execute 335 sec latency 295.331 ms 2024-01-19T04:41:15.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4148 0.04 MB/sec execute 336 sec latency 452.035 ms 2024-01-19T04:41:16.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4155 0.04 MB/sec execute 337 sec latency 570.432 ms 2024-01-19T04:41:17.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4162 0.04 MB/sec execute 338 sec latency 400.090 ms 2024-01-19T04:41:18.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4172 0.04 MB/sec execute 339 sec latency 677.377 ms 2024-01-19T04:41:19.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4173 0.04 MB/sec execute 340 sec latency 553.945 ms 2024-01-19T04:41:20.571 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4176 0.04 MB/sec execute 341 sec latency 1111.922 ms 2024-01-19T04:41:21.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4181 0.04 MB/sec execute 342 sec latency 964.031 ms 2024-01-19T04:41:22.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4186 0.04 MB/sec execute 343 sec latency 869.580 ms 2024-01-19T04:41:23.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4214 0.04 MB/sec execute 344 sec latency 820.782 ms 2024-01-19T04:41:24.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4216 0.04 MB/sec execute 345 sec latency 939.220 ms 2024-01-19T04:41:25.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4217 0.04 MB/sec execute 346 sec latency 998.941 ms 2024-01-19T04:41:26.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4225 0.04 MB/sec execute 347 sec latency 1086.250 ms 2024-01-19T04:41:27.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4226 0.04 MB/sec execute 348 sec latency 926.059 ms 2024-01-19T04:41:28.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4245 0.04 MB/sec execute 349 sec latency 461.257 ms 2024-01-19T04:41:29.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4252 0.04 MB/sec execute 350 sec latency 796.908 ms 2024-01-19T04:41:30.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4254 0.04 MB/sec execute 351 sec latency 902.505 ms 2024-01-19T04:41:31.572 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4270 0.04 MB/sec execute 352 sec latency 1153.301 ms 2024-01-19T04:41:32.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4282 0.04 MB/sec execute 353 sec latency 640.223 ms 2024-01-19T04:41:33.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4297 0.04 MB/sec execute 354 sec latency 299.971 ms 2024-01-19T04:41:34.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4315 0.04 MB/sec execute 355 sec latency 176.176 ms 2024-01-19T04:41:35.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4317 0.04 MB/sec execute 356 sec latency 1025.033 ms 2024-01-19T04:41:36.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4318 0.04 MB/sec execute 357 sec latency 929.447 ms 2024-01-19T04:41:37.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4347 0.04 MB/sec execute 358 sec latency 357.753 ms 2024-01-19T04:41:38.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4351 0.04 MB/sec execute 359 sec latency 656.242 ms 2024-01-19T04:41:39.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4370 0.04 MB/sec execute 360 sec latency 311.251 ms 2024-01-19T04:41:40.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4383 0.04 MB/sec execute 361 sec latency 286.880 ms 2024-01-19T04:41:40.976 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:41:40.979 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:41:41.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4384 0.04 MB/sec execute 362 sec latency 929.610 ms 2024-01-19T04:41:42.573 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4387 0.04 MB/sec execute 363 sec latency 905.290 ms 2024-01-19T04:41:43.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4388 0.04 MB/sec execute 364 sec latency 885.028 ms 2024-01-19T04:41:44.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4395 0.04 MB/sec execute 365 sec latency 919.842 ms 2024-01-19T04:41:45.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4423 0.04 MB/sec execute 366 sec latency 697.193 ms 2024-01-19T04:41:46.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4424 0.04 MB/sec execute 367 sec latency 1014.128 ms 2024-01-19T04:41:47.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4432 0.04 MB/sec execute 368 sec latency 947.226 ms 2024-01-19T04:41:48.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4433 0.04 MB/sec execute 369 sec latency 931.550 ms 2024-01-19T04:41:49.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4450 0.04 MB/sec execute 370 sec latency 386.363 ms 2024-01-19T04:41:50.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4452 0.04 MB/sec execute 371 sec latency 1091.836 ms 2024-01-19T04:41:51.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4472 0.04 MB/sec execute 372 sec latency 430.881 ms 2024-01-19T04:41:52.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4474 0.04 MB/sec execute 373 sec latency 684.229 ms 2024-01-19T04:41:53.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4496 0.04 MB/sec execute 374 sec latency 261.058 ms 2024-01-19T04:41:54.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4497 0.04 MB/sec execute 375 sec latency 908.696 ms 2024-01-19T04:41:55.574 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4498 0.04 MB/sec execute 376 sec latency 993.517 ms 2024-01-19T04:41:56.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4500 0.04 MB/sec execute 377 sec latency 1046.051 ms 2024-01-19T04:41:57.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4501 0.04 MB/sec execute 378 sec latency 835.518 ms 2024-01-19T04:41:58.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4506 0.04 MB/sec execute 379 sec latency 1019.807 ms 2024-01-19T04:41:59.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4511 0.04 MB/sec execute 380 sec latency 918.361 ms 2024-01-19T04:42:00.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4521 0.04 MB/sec execute 381 sec latency 1044.198 ms 2024-01-19T04:42:01.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4538 0.04 MB/sec execute 382 sec latency 281.555 ms 2024-01-19T04:42:02.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4544 0.04 MB/sec execute 383 sec latency 611.079 ms 2024-01-19T04:42:03.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4563 0.04 MB/sec execute 384 sec latency 181.685 ms 2024-01-19T04:42:04.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4567 0.04 MB/sec execute 385 sec latency 911.289 ms 2024-01-19T04:42:05.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4596 0.04 MB/sec execute 386 sec latency 343.156 ms 2024-01-19T04:42:06.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4600 0.04 MB/sec execute 387 sec latency 920.415 ms 2024-01-19T04:42:07.575 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4602 0.04 MB/sec execute 388 sec latency 859.023 ms 2024-01-19T04:42:08.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4614 0.04 MB/sec execute 389 sec latency 1032.335 ms 2024-01-19T04:42:09.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4615 0.04 MB/sec execute 390 sec latency 934.018 ms 2024-01-19T04:42:10.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4616 0.04 MB/sec execute 391 sec latency 1136.031 ms 2024-01-19T04:42:11.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:42:11.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:42:11.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4618 0.04 MB/sec execute 392 sec latency 1037.761 ms 2024-01-19T04:42:12.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4628 0.04 MB/sec execute 393 sec latency 312.808 ms 2024-01-19T04:42:13.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4639 0.04 MB/sec execute 394 sec latency 411.114 ms 2024-01-19T04:42:14.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4656 0.04 MB/sec execute 395 sec latency 366.894 ms 2024-01-19T04:42:15.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4659 0.04 MB/sec execute 396 sec latency 1016.350 ms 2024-01-19T04:42:16.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4668 0.04 MB/sec execute 397 sec latency 437.129 ms 2024-01-19T04:42:17.576 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4681 0.04 MB/sec execute 398 sec latency 923.319 ms 2024-01-19T04:42:18.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4681 0.04 MB/sec execute 399 sec latency 1061.184 ms 2024-01-19T04:42:19.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4695 0.04 MB/sec execute 400 sec latency 1081.226 ms 2024-01-19T04:42:20.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4705 0.04 MB/sec execute 401 sec latency 483.150 ms 2024-01-19T04:42:21.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4723 0.04 MB/sec execute 402 sec latency 515.253 ms 2024-01-19T04:42:22.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4724 0.04 MB/sec execute 403 sec latency 785.140 ms 2024-01-19T04:42:23.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4734 0.04 MB/sec execute 404 sec latency 1037.403 ms 2024-01-19T04:42:24.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4735 0.04 MB/sec execute 405 sec latency 946.843 ms 2024-01-19T04:42:25.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4736 0.04 MB/sec execute 406 sec latency 899.159 ms 2024-01-19T04:42:26.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4739 0.04 MB/sec execute 407 sec latency 889.196 ms 2024-01-19T04:42:27.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4746 0.04 MB/sec execute 408 sec latency 400.909 ms 2024-01-19T04:42:28.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4766 0.04 MB/sec execute 409 sec latency 315.316 ms 2024-01-19T04:42:29.577 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4770 0.04 MB/sec execute 410 sec latency 696.005 ms 2024-01-19T04:42:30.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4777 0.04 MB/sec execute 411 sec latency 973.194 ms 2024-01-19T04:42:31.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4791 0.04 MB/sec execute 412 sec latency 325.503 ms 2024-01-19T04:42:32.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4806 0.04 MB/sec execute 413 sec latency 342.536 ms 2024-01-19T04:42:33.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4814 0.04 MB/sec execute 414 sec latency 568.554 ms 2024-01-19T04:42:34.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4817 0.04 MB/sec execute 415 sec latency 976.344 ms 2024-01-19T04:42:35.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4839 0.04 MB/sec execute 416 sec latency 284.516 ms 2024-01-19T04:42:36.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4844 0.04 MB/sec execute 417 sec latency 624.437 ms 2024-01-19T04:42:37.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4846 0.04 MB/sec execute 418 sec latency 956.764 ms 2024-01-19T04:42:38.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4847 0.04 MB/sec execute 419 sec latency 1130.212 ms 2024-01-19T04:42:39.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4850 0.04 MB/sec execute 420 sec latency 977.324 ms 2024-01-19T04:42:40.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4884 0.04 MB/sec execute 421 sec latency 841.254 ms 2024-01-19T04:42:41.216 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:42:41.218 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:42:41.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4943 0.05 MB/sec execute 422 sec latency 921.236 ms 2024-01-19T04:42:42.578 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4944 0.05 MB/sec execute 423 sec latency 921.327 ms 2024-01-19T04:42:43.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4947 0.05 MB/sec execute 424 sec latency 565.102 ms 2024-01-19T04:42:44.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4951 0.04 MB/sec execute 425 sec latency 887.712 ms 2024-01-19T04:42:45.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4959 0.04 MB/sec execute 426 sec latency 959.520 ms 2024-01-19T04:42:46.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4963 0.04 MB/sec execute 427 sec latency 342.319 ms 2024-01-19T04:42:47.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4969 0.04 MB/sec execute 428 sec latency 906.204 ms 2024-01-19T04:42:48.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4983 0.04 MB/sec execute 429 sec latency 564.367 ms 2024-01-19T04:42:49.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4985 0.04 MB/sec execute 430 sec latency 942.549 ms 2024-01-19T04:42:50.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 4997 0.04 MB/sec execute 431 sec latency 453.567 ms 2024-01-19T04:42:51.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5014 0.04 MB/sec execute 432 sec latency 425.294 ms 2024-01-19T04:42:52.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5015 0.04 MB/sec execute 433 sec latency 961.431 ms 2024-01-19T04:42:53.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5030 0.04 MB/sec execute 434 sec latency 188.439 ms 2024-01-19T04:42:54.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5032 0.04 MB/sec execute 435 sec latency 632.484 ms 2024-01-19T04:42:55.579 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5051 0.04 MB/sec execute 436 sec latency 1000.846 ms 2024-01-19T04:42:56.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5052 0.04 MB/sec execute 437 sec latency 1042.502 ms 2024-01-19T04:42:57.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5056 0.04 MB/sec execute 438 sec latency 470.823 ms 2024-01-19T04:42:58.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5058 0.04 MB/sec execute 439 sec latency 978.642 ms 2024-01-19T04:42:59.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5068 0.04 MB/sec execute 440 sec latency 526.962 ms 2024-01-19T04:43:00.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5078 0.04 MB/sec execute 441 sec latency 562.553 ms 2024-01-19T04:43:01.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5091 0.04 MB/sec execute 442 sec latency 602.212 ms 2024-01-19T04:43:02.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5092 0.04 MB/sec execute 443 sec latency 967.047 ms 2024-01-19T04:43:03.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5096 0.04 MB/sec execute 444 sec latency 988.661 ms 2024-01-19T04:43:04.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5118 0.04 MB/sec execute 445 sec latency 984.464 ms 2024-01-19T04:43:05.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5120 0.04 MB/sec execute 446 sec latency 551.070 ms 2024-01-19T04:43:06.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5129 0.04 MB/sec execute 447 sec latency 947.106 ms 2024-01-19T04:43:07.580 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5141 0.04 MB/sec execute 448 sec latency 272.636 ms 2024-01-19T04:43:08.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5152 0.04 MB/sec execute 449 sec latency 175.445 ms 2024-01-19T04:43:09.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5154 0.04 MB/sec execute 450 sec latency 570.576 ms 2024-01-19T04:43:10.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5162 0.04 MB/sec execute 451 sec latency 1464.258 ms 2024-01-19T04:43:11.504 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:43:11.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:43:11.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5171 0.04 MB/sec execute 452 sec latency 372.489 ms 2024-01-19T04:43:12.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5175 0.04 MB/sec execute 453 sec latency 843.752 ms 2024-01-19T04:43:13.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5179 0.04 MB/sec execute 454 sec latency 907.714 ms 2024-01-19T04:43:14.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5182 0.04 MB/sec execute 455 sec latency 463.037 ms 2024-01-19T04:43:15.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5203 0.04 MB/sec execute 456 sec latency 913.885 ms 2024-01-19T04:43:16.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5206 0.04 MB/sec execute 457 sec latency 932.173 ms 2024-01-19T04:43:17.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5209 0.04 MB/sec execute 458 sec latency 939.548 ms 2024-01-19T04:43:18.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5218 0.04 MB/sec execute 459 sec latency 965.093 ms 2024-01-19T04:43:19.581 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5240 0.04 MB/sec execute 460 sec latency 620.072 ms 2024-01-19T04:43:20.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5251 0.04 MB/sec execute 461 sec latency 610.801 ms 2024-01-19T04:43:21.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5263 0.04 MB/sec execute 462 sec latency 767.569 ms 2024-01-19T04:43:22.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5266 0.04 MB/sec execute 463 sec latency 536.989 ms 2024-01-19T04:43:23.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5272 0.04 MB/sec execute 464 sec latency 946.766 ms 2024-01-19T04:43:24.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5278 0.04 MB/sec execute 465 sec latency 911.595 ms 2024-01-19T04:43:25.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5294 0.04 MB/sec execute 466 sec latency 226.512 ms 2024-01-19T04:43:26.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5332 0.04 MB/sec execute 467 sec latency 182.968 ms 2024-01-19T04:43:27.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5337 0.04 MB/sec execute 468 sec latency 488.656 ms 2024-01-19T04:43:28.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5344 0.04 MB/sec execute 469 sec latency 894.917 ms 2024-01-19T04:43:29.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5368 0.04 MB/sec execute 470 sec latency 177.649 ms 2024-01-19T04:43:30.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5371 0.04 MB/sec execute 471 sec latency 341.544 ms 2024-01-19T04:43:31.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5385 0.04 MB/sec execute 472 sec latency 945.350 ms 2024-01-19T04:43:32.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5387 0.04 MB/sec execute 473 sec latency 570.634 ms 2024-01-19T04:43:33.582 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5391 0.04 MB/sec execute 474 sec latency 936.202 ms 2024-01-19T04:43:34.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5399 0.04 MB/sec execute 475 sec latency 917.878 ms 2024-01-19T04:43:35.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5405 0.04 MB/sec execute 476 sec latency 348.531 ms 2024-01-19T04:43:36.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5406 0.04 MB/sec execute 477 sec latency 770.432 ms 2024-01-19T04:43:37.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5423 0.04 MB/sec execute 478 sec latency 910.242 ms 2024-01-19T04:43:38.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5426 0.04 MB/sec execute 479 sec latency 868.012 ms 2024-01-19T04:43:39.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5429 0.04 MB/sec execute 480 sec latency 898.463 ms 2024-01-19T04:43:40.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5434 0.04 MB/sec execute 481 sec latency 351.829 ms 2024-01-19T04:43:41.571 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:43:41.574 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:43:41.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5442 0.04 MB/sec execute 482 sec latency 972.046 ms 2024-01-19T04:43:42.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5463 0.04 MB/sec execute 483 sec latency 316.155 ms 2024-01-19T04:43:43.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5468 0.04 MB/sec execute 484 sec latency 933.672 ms 2024-01-19T04:43:44.583 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5474 0.04 MB/sec execute 485 sec latency 904.271 ms 2024-01-19T04:43:45.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5477 0.04 MB/sec execute 486 sec latency 654.209 ms 2024-01-19T04:43:46.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5485 0.04 MB/sec execute 487 sec latency 1104.902 ms 2024-01-19T04:43:47.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5515 0.04 MB/sec execute 488 sec latency 894.880 ms 2024-01-19T04:43:48.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5538 0.04 MB/sec execute 489 sec latency 178.797 ms 2024-01-19T04:43:49.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5540 0.04 MB/sec execute 490 sec latency 551.372 ms 2024-01-19T04:43:50.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5554 0.04 MB/sec execute 491 sec latency 935.993 ms 2024-01-19T04:43:51.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5562 0.04 MB/sec execute 492 sec latency 665.424 ms 2024-01-19T04:43:52.519 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:13:40.147 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.524 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:13:40.152 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5581 0.04 MB/sec execute 493 sec latency 961.175 ms 2024-01-19T04:43:52.631 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:40.241 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.633 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:40.243 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.637 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:13:40.248 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.644 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:13:40.255 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.687 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:13:40.315 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.734 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:40.344 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:52.806 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:13:40.417 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:43:53.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5597 0.04 MB/sec execute 494 sec latency 207.772 ms 2024-01-19T04:43:54.584 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5604 0.04 MB/sec execute 495 sec latency 940.508 ms 2024-01-19T04:43:55.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5605 0.04 MB/sec execute 496 sec latency 885.048 ms 2024-01-19T04:43:56.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5613 0.04 MB/sec execute 497 sec latency 963.709 ms 2024-01-19T04:43:57.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5615 0.04 MB/sec execute 498 sec latency 944.512 ms 2024-01-19T04:43:58.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5621 0.04 MB/sec execute 499 sec latency 931.707 ms 2024-01-19T04:43:59.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5623 0.04 MB/sec execute 500 sec latency 674.342 ms 2024-01-19T04:44:00.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5641 0.04 MB/sec execute 501 sec latency 992.170 ms 2024-01-19T04:44:01.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5642 0.04 MB/sec execute 502 sec latency 1154.702 ms 2024-01-19T04:44:02.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5643 0.04 MB/sec execute 503 sec latency 967.525 ms 2024-01-19T04:44:03.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5655 0.04 MB/sec execute 504 sec latency 984.576 ms 2024-01-19T04:44:04.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5658 0.04 MB/sec execute 505 sec latency 942.088 ms 2024-01-19T04:44:05.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5665 0.04 MB/sec execute 506 sec latency 1075.807 ms 2024-01-19T04:44:06.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5700 0.04 MB/sec execute 507 sec latency 198.615 ms 2024-01-19T04:44:07.585 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5702 0.04 MB/sec execute 508 sec latency 659.947 ms 2024-01-19T04:44:08.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5708 0.04 MB/sec execute 509 sec latency 932.844 ms 2024-01-19T04:44:09.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5728 0.04 MB/sec execute 510 sec latency 899.674 ms 2024-01-19T04:44:10.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5735 0.04 MB/sec execute 511 sec latency 865.202 ms 2024-01-19T04:44:11.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5737 0.04 MB/sec execute 512 sec latency 1173.479 ms 2024-01-19T04:44:11.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:44:11.634 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:44:12.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5740 0.04 MB/sec execute 513 sec latency 1178.750 ms 2024-01-19T04:44:13.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5744 0.04 MB/sec execute 514 sec latency 304.391 ms 2024-01-19T04:44:14.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5758 0.04 MB/sec execute 515 sec latency 930.856 ms 2024-01-19T04:44:15.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5762 0.04 MB/sec execute 516 sec latency 563.013 ms 2024-01-19T04:44:16.586 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5782 0.04 MB/sec execute 517 sec latency 297.379 ms 2024-01-19T04:44:17.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5793 0.04 MB/sec execute 518 sec latency 931.588 ms 2024-01-19T04:44:18.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5823 0.04 MB/sec execute 519 sec latency 177.660 ms 2024-01-19T04:44:19.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5853 0.04 MB/sec execute 520 sec latency 367.748 ms 2024-01-19T04:44:20.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5855 0.04 MB/sec execute 521 sec latency 938.273 ms 2024-01-19T04:44:21.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5863 0.04 MB/sec execute 522 sec latency 495.203 ms 2024-01-19T04:44:22.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5866 0.04 MB/sec execute 523 sec latency 955.227 ms 2024-01-19T04:44:23.587 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5867 0.04 MB/sec execute 524 sec latency 871.640 ms 2024-01-19T04:44:24.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5867 0.04 MB/sec execute 525 sec latency 1174.764 ms 2024-01-19T04:44:25.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5881 0.04 MB/sec execute 526 sec latency 1348.705 ms 2024-01-19T04:44:26.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5884 0.04 MB/sec execute 527 sec latency 1185.482 ms 2024-01-19T04:44:27.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5894 0.04 MB/sec execute 528 sec latency 929.058 ms 2024-01-19T04:44:28.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5895 0.04 MB/sec execute 529 sec latency 728.936 ms 2024-01-19T04:44:29.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5900 0.04 MB/sec execute 530 sec latency 914.078 ms 2024-01-19T04:44:30.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5907 0.04 MB/sec execute 531 sec latency 990.412 ms 2024-01-19T04:44:31.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5921 0.04 MB/sec execute 532 sec latency 362.077 ms 2024-01-19T04:44:32.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5922 0.04 MB/sec execute 533 sec latency 918.556 ms 2024-01-19T04:44:33.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5922 0.04 MB/sec execute 534 sec latency 1099.507 ms 2024-01-19T04:44:34.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5924 0.04 MB/sec execute 535 sec latency 1112.990 ms 2024-01-19T04:44:35.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5926 0.04 MB/sec execute 536 sec latency 1029.608 ms 2024-01-19T04:44:36.588 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5931 0.04 MB/sec execute 537 sec latency 1119.361 ms 2024-01-19T04:44:37.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5937 0.04 MB/sec execute 538 sec latency 991.266 ms 2024-01-19T04:44:38.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5949 0.04 MB/sec execute 539 sec latency 592.962 ms 2024-01-19T04:44:39.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5951 0.04 MB/sec execute 540 sec latency 872.178 ms 2024-01-19T04:44:40.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5956 0.04 MB/sec execute 541 sec latency 970.674 ms 2024-01-19T04:44:41.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5966 0.04 MB/sec execute 542 sec latency 493.433 ms 2024-01-19T04:44:41.774 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:44:41.777 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:44:42.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5970 0.04 MB/sec execute 543 sec latency 445.715 ms 2024-01-19T04:44:43.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5982 0.04 MB/sec execute 544 sec latency 1020.367 ms 2024-01-19T04:44:44.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5991 0.04 MB/sec execute 545 sec latency 550.039 ms 2024-01-19T04:44:45.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5992 0.04 MB/sec execute 546 sec latency 1040.473 ms 2024-01-19T04:44:46.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5994 0.04 MB/sec execute 547 sec latency 939.457 ms 2024-01-19T04:44:47.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6000 0.04 MB/sec execute 548 sec latency 269.185 ms 2024-01-19T04:44:48.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6009 0.04 MB/sec execute 549 sec latency 313.141 ms 2024-01-19T04:44:49.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6020 0.04 MB/sec execute 550 sec latency 388.430 ms 2024-01-19T04:44:50.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6030 0.04 MB/sec execute 551 sec latency 331.963 ms 2024-01-19T04:44:51.589 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6033 0.04 MB/sec execute 552 sec latency 1267.353 ms 2024-01-19T04:44:52.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6049 0.04 MB/sec execute 553 sec latency 374.204 ms 2024-01-19T04:44:53.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6052 0.04 MB/sec execute 554 sec latency 713.181 ms 2024-01-19T04:44:54.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6054 0.04 MB/sec execute 555 sec latency 1045.808 ms 2024-01-19T04:44:55.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6057 0.04 MB/sec execute 556 sec latency 1062.841 ms 2024-01-19T04:44:56.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6064 0.04 MB/sec execute 557 sec latency 257.673 ms 2024-01-19T04:44:57.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6107 0.04 MB/sec execute 558 sec latency 916.057 ms 2024-01-19T04:44:58.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6109 0.04 MB/sec execute 559 sec latency 937.679 ms 2024-01-19T04:44:59.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6116 0.04 MB/sec execute 560 sec latency 873.424 ms 2024-01-19T04:45:00.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6118 0.04 MB/sec execute 561 sec latency 517.810 ms 2024-01-19T04:45:01.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6124 0.04 MB/sec execute 562 sec latency 1050.950 ms 2024-01-19T04:45:02.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6138 0.04 MB/sec execute 563 sec latency 337.653 ms 2024-01-19T04:45:03.590 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6139 0.04 MB/sec execute 564 sec latency 928.413 ms 2024-01-19T04:45:04.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6140 0.04 MB/sec execute 565 sec latency 897.806 ms 2024-01-19T04:45:05.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6154 0.04 MB/sec execute 566 sec latency 364.466 ms 2024-01-19T04:45:06.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6158 0.04 MB/sec execute 567 sec latency 636.312 ms 2024-01-19T04:45:07.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6161 0.04 MB/sec execute 568 sec latency 956.199 ms 2024-01-19T04:45:08.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6167 0.04 MB/sec execute 569 sec latency 407.394 ms 2024-01-19T04:45:09.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6173 0.04 MB/sec execute 570 sec latency 773.650 ms 2024-01-19T04:45:10.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6175 0.04 MB/sec execute 571 sec latency 923.003 ms 2024-01-19T04:45:11.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6176 0.04 MB/sec execute 572 sec latency 1233.407 ms 2024-01-19T04:45:11.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:45:11.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:45:12.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6179 0.04 MB/sec execute 573 sec latency 900.663 ms 2024-01-19T04:45:13.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6275 0.04 MB/sec execute 574 sec latency 890.935 ms 2024-01-19T04:45:14.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6275 0.04 MB/sec execute 575 sec latency 1048.648 ms 2024-01-19T04:45:15.591 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6302 0.04 MB/sec execute 576 sec latency 1051.743 ms 2024-01-19T04:45:16.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6308 0.04 MB/sec execute 577 sec latency 937.756 ms 2024-01-19T04:45:17.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6316 0.04 MB/sec execute 578 sec latency 713.109 ms 2024-01-19T04:45:18.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6320 0.04 MB/sec execute 579 sec latency 924.530 ms 2024-01-19T04:45:19.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6331 0.04 MB/sec execute 580 sec latency 311.431 ms 2024-01-19T04:45:20.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6336 0.04 MB/sec execute 581 sec latency 580.620 ms 2024-01-19T04:45:21.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6353 0.04 MB/sec execute 582 sec latency 1113.209 ms 2024-01-19T04:45:22.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6427 0.04 MB/sec execute 583 sec latency 945.835 ms 2024-01-19T04:45:23.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6435 0.04 MB/sec execute 584 sec latency 1027.515 ms 2024-01-19T04:45:24.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6452 0.04 MB/sec execute 585 sec latency 402.503 ms 2024-01-19T04:45:25.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6458 0.04 MB/sec execute 586 sec latency 411.578 ms 2024-01-19T04:45:26.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6477 0.05 MB/sec execute 587 sec latency 371.419 ms 2024-01-19T04:45:27.592 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6486 0.05 MB/sec execute 588 sec latency 591.991 ms 2024-01-19T04:45:28.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6493 0.05 MB/sec execute 589 sec latency 620.957 ms 2024-01-19T04:45:29.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6521 0.05 MB/sec execute 590 sec latency 930.998 ms 2024-01-19T04:45:30.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6522 0.05 MB/sec execute 591 sec latency 963.819 ms 2024-01-19T04:45:31.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6529 0.04 MB/sec execute 592 sec latency 324.833 ms 2024-01-19T04:45:32.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6530 0.04 MB/sec execute 593 sec latency 888.185 ms 2024-01-19T04:45:33.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6539 0.04 MB/sec execute 594 sec latency 403.853 ms 2024-01-19T04:45:34.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6549 0.04 MB/sec execute 595 sec latency 340.167 ms 2024-01-19T04:45:35.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6550 0.04 MB/sec execute 596 sec latency 933.559 ms 2024-01-19T04:45:36.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6567 0.04 MB/sec execute 597 sec latency 271.659 ms 2024-01-19T04:45:37.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6572 0.04 MB/sec execute 598 sec latency 583.680 ms 2024-01-19T04:45:38.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6579 0.04 MB/sec execute 599 sec latency 309.252 ms 2024-01-19T04:45:39.593 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 600 sec 2024-01-19T04:45:40.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 601 sec 2024-01-19T04:45:41.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 602 sec 2024-01-19T04:45:41.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:45:41.925 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:45:42.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 603 sec 2024-01-19T04:45:43.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 604 sec 2024-01-19T04:45:44.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 605 sec 2024-01-19T04:45:45.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 606 sec 2024-01-19T04:45:46.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 607 sec 2024-01-19T04:45:47.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 608 sec 2024-01-19T04:45:48.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 609 sec 2024-01-19T04:45:49.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 610 sec 2024-01-19T04:45:50.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 611 sec 2024-01-19T04:45:51.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 612 sec 2024-01-19T04:45:52.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 613 sec 2024-01-19T04:45:53.594 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 614 sec 2024-01-19T04:45:54.595 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 615 sec 2024-01-19T04:45:55.595 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 616 sec 2024-01-19T04:45:56.595 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 617 sec 2024-01-19T04:45:57.595 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 618 sec 2024-01-19T04:45:58.595 INFO:tasks.workunit.client.0.smithi133.stdout: 1 cleanup 619 sec 2024-01-19T04:45:58.745 INFO:tasks.workunit.client.0.smithi133.stdout: 0 cleanup 619 sec 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Operation Count AvgLat MaxLat 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: ---------------------------------------- 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: NTCreateX 902 171.774 737.981 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Close 681 3.723 54.266 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Rename 37 501.404 767.551 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Unlink 154 165.344 452.019 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Qpathinfo 873 97.141 576.630 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Qfileinfo 165 2.860 7.670 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Qfsinfo 125 26.474 513.631 2024-01-19T04:45:58.746 INFO:tasks.workunit.client.0.smithi133.stdout: Sfileinfo 66 35.036 49.335 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: Find 306 965.830 1464.247 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: WriteX 459 11.251 237.974 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: ReadX 1378 0.085 6.520 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: LockX 4 58.264 106.489 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: UnlockX 4 50.135 64.728 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: Flush 57 124.577 263.369 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stdout:Throughput 0.0445066 MB/sec 1 clients 1 procs max_latency=1464.258 ms 2024-01-19T04:45:58.747 INFO:tasks.workunit.client.0.smithi133.stderr:+ dbench 10 2024-01-19T04:45:58.748 INFO:tasks.workunit.client.0.smithi133.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-19T04:45:58.748 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-01-19T04:45:58.748 INFO:tasks.workunit.client.0.smithi133.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-19T04:45:58.748 INFO:tasks.workunit.client.0.smithi133.stdout:9 of 10 processes prepared for launch 0 sec 2024-01-19T04:45:58.848 INFO:tasks.workunit.client.0.smithi133.stdout:10 of 10 processes prepared for launch 0 sec 2024-01-19T04:45:58.848 INFO:tasks.workunit.client.0.smithi133.stdout:releasing clients 2024-01-19T04:45:59.848 INFO:tasks.workunit.client.0.smithi133.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.918 ms 2024-01-19T04:46:00.848 INFO:tasks.workunit.client.0.smithi133.stdout: 0 3 0.00 MB/sec warmup 2 sec latency 2000.024 ms 2024-01-19T04:46:01.848 INFO:tasks.workunit.client.0.smithi133.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 3000.096 ms 2024-01-19T04:46:02.849 INFO:tasks.workunit.client.0.smithi133.stdout: 1 5 0.16 MB/sec warmup 4 sec latency 4000.156 ms 2024-01-19T04:46:03.848 INFO:tasks.workunit.client.0.smithi133.stdout: 1 6 0.21 MB/sec warmup 5 sec latency 5000.216 ms 2024-01-19T04:46:04.849 INFO:tasks.workunit.client.0.smithi133.stdout: 1 10 0.35 MB/sec warmup 6 sec latency 5162.668 ms 2024-01-19T04:46:05.849 INFO:tasks.workunit.client.0.smithi133.stdout: 2 14 0.45 MB/sec warmup 7 sec latency 1121.567 ms 2024-01-19T04:46:06.849 INFO:tasks.workunit.client.0.smithi133.stdout: 3 17 0.54 MB/sec warmup 8 sec latency 1229.470 ms 2024-01-19T04:46:07.849 INFO:tasks.workunit.client.0.smithi133.stdout: 4 21 0.69 MB/sec warmup 9 sec latency 1290.639 ms 2024-01-19T04:46:08.849 INFO:tasks.workunit.client.0.smithi133.stdout: 5 26 0.80 MB/sec warmup 10 sec latency 1528.472 ms 2024-01-19T04:46:09.849 INFO:tasks.workunit.client.0.smithi133.stdout: 7 31 0.95 MB/sec warmup 11 sec latency 1588.712 ms 2024-01-19T04:46:10.849 INFO:tasks.workunit.client.0.smithi133.stdout: 10 40 1.26 MB/sec warmup 12 sec latency 1698.060 ms 2024-01-19T04:46:11.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 45 1.38 MB/sec warmup 13 sec latency 1853.065 ms 2024-01-19T04:46:12.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:46:12.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:46:12.849 INFO:tasks.workunit.client.0.smithi133.stdout: 10 50 1.45 MB/sec warmup 14 sec latency 1781.028 ms 2024-01-19T04:46:13.849 INFO:tasks.workunit.client.0.smithi133.stdout: 10 57 1.58 MB/sec warmup 15 sec latency 1749.430 ms 2024-01-19T04:46:14.849 INFO:tasks.workunit.client.0.smithi133.stdout: 10 63 1.70 MB/sec warmup 16 sec latency 1982.009 ms 2024-01-19T04:46:15.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 67 1.71 MB/sec warmup 17 sec latency 1868.537 ms 2024-01-19T04:46:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 74 1.82 MB/sec warmup 18 sec latency 1965.386 ms 2024-01-19T04:46:17.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 80 1.90 MB/sec warmup 19 sec latency 1731.651 ms 2024-01-19T04:46:18.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 86 1.96 MB/sec warmup 20 sec latency 1913.841 ms 2024-01-19T04:46:19.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 91 1.96 MB/sec warmup 21 sec latency 2098.857 ms 2024-01-19T04:46:20.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 96 2.01 MB/sec warmup 22 sec latency 1964.581 ms 2024-01-19T04:46:21.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 101 2.03 MB/sec warmup 23 sec latency 2268.442 ms 2024-01-19T04:46:22.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 106 2.05 MB/sec warmup 24 sec latency 2817.709 ms 2024-01-19T04:46:23.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 111 2.06 MB/sec warmup 25 sec latency 2072.625 ms 2024-01-19T04:46:24.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 116 2.07 MB/sec warmup 26 sec latency 2123.482 ms 2024-01-19T04:46:25.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 118 2.02 MB/sec warmup 27 sec latency 2086.170 ms 2024-01-19T04:46:26.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 119 1.95 MB/sec warmup 28 sec latency 2451.736 ms 2024-01-19T04:46:27.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 122 1.91 MB/sec warmup 29 sec latency 2844.718 ms 2024-01-19T04:46:28.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 125 1.87 MB/sec warmup 30 sec latency 3138.826 ms 2024-01-19T04:46:29.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 128 1.85 MB/sec warmup 31 sec latency 2483.205 ms 2024-01-19T04:46:30.850 INFO:tasks.workunit.client.0.smithi133.stdout: 10 131 1.82 MB/sec warmup 32 sec latency 2720.132 ms 2024-01-19T04:46:31.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 134 1.79 MB/sec warmup 33 sec latency 2062.308 ms 2024-01-19T04:46:32.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 137 1.76 MB/sec warmup 34 sec latency 2254.311 ms 2024-01-19T04:46:33.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 140 1.74 MB/sec warmup 35 sec latency 2459.492 ms 2024-01-19T04:46:34.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 143 1.72 MB/sec warmup 36 sec latency 2231.473 ms 2024-01-19T04:46:35.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 146 1.69 MB/sec warmup 37 sec latency 2213.628 ms 2024-01-19T04:46:36.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 148 1.66 MB/sec warmup 38 sec latency 2293.134 ms 2024-01-19T04:46:37.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 150 1.62 MB/sec warmup 39 sec latency 2694.868 ms 2024-01-19T04:46:38.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 154 1.63 MB/sec warmup 40 sec latency 2750.596 ms 2024-01-19T04:46:39.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 156 1.60 MB/sec warmup 41 sec latency 2826.064 ms 2024-01-19T04:46:40.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 157 1.57 MB/sec warmup 42 sec latency 2832.829 ms 2024-01-19T04:46:41.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 159 1.55 MB/sec warmup 43 sec latency 3163.685 ms 2024-01-19T04:46:42.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:46:42.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:46:42.851 INFO:tasks.workunit.client.0.smithi133.stdout: 10 162 1.53 MB/sec warmup 44 sec latency 3511.345 ms 2024-01-19T04:46:43.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 164 1.51 MB/sec warmup 45 sec latency 2810.836 ms 2024-01-19T04:46:44.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 167 1.50 MB/sec warmup 46 sec latency 2658.067 ms 2024-01-19T04:46:45.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 170 1.49 MB/sec warmup 47 sec latency 1961.298 ms 2024-01-19T04:46:46.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 173 1.48 MB/sec warmup 48 sec latency 2755.231 ms 2024-01-19T04:46:47.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 175 1.46 MB/sec warmup 49 sec latency 2872.805 ms 2024-01-19T04:46:48.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 178 1.44 MB/sec warmup 50 sec latency 3211.156 ms 2024-01-19T04:46:49.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 182 1.44 MB/sec warmup 51 sec latency 2775.624 ms 2024-01-19T04:46:50.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 187 1.44 MB/sec warmup 52 sec latency 2142.203 ms 2024-01-19T04:46:51.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 188 1.42 MB/sec warmup 53 sec latency 2274.443 ms 2024-01-19T04:46:52.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 190 1.41 MB/sec warmup 54 sec latency 2643.915 ms 2024-01-19T04:46:53.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 195 1.41 MB/sec warmup 55 sec latency 2833.432 ms 2024-01-19T04:46:54.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 197 1.40 MB/sec warmup 56 sec latency 2701.828 ms 2024-01-19T04:46:55.852 INFO:tasks.workunit.client.0.smithi133.stdout: 10 200 1.39 MB/sec warmup 57 sec latency 2216.085 ms 2024-01-19T04:46:56.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 203 1.38 MB/sec warmup 58 sec latency 3087.787 ms 2024-01-19T04:46:57.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 204 1.36 MB/sec warmup 59 sec latency 2882.532 ms 2024-01-19T04:46:58.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 208 1.36 MB/sec warmup 60 sec latency 3102.125 ms 2024-01-19T04:46:59.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 211 1.35 MB/sec warmup 61 sec latency 2431.141 ms 2024-01-19T04:47:00.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 213 1.34 MB/sec warmup 62 sec latency 2133.857 ms 2024-01-19T04:47:01.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 215 1.33 MB/sec warmup 63 sec latency 3004.907 ms 2024-01-19T04:47:02.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 219 1.33 MB/sec warmup 64 sec latency 3110.526 ms 2024-01-19T04:47:03.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 219 1.31 MB/sec warmup 65 sec latency 3457.741 ms 2024-01-19T04:47:04.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 221 1.30 MB/sec warmup 66 sec latency 4138.151 ms 2024-01-19T04:47:05.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 225 1.30 MB/sec warmup 67 sec latency 3672.008 ms 2024-01-19T04:47:06.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 228 1.29 MB/sec warmup 68 sec latency 3982.506 ms 2024-01-19T04:47:07.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 230 1.28 MB/sec warmup 69 sec latency 2518.219 ms 2024-01-19T04:47:08.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 230 1.27 MB/sec warmup 70 sec latency 3518.320 ms 2024-01-19T04:47:09.853 INFO:tasks.workunit.client.0.smithi133.stdout: 10 232 1.26 MB/sec warmup 71 sec latency 3931.626 ms 2024-01-19T04:47:10.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 236 1.26 MB/sec warmup 72 sec latency 4248.564 ms 2024-01-19T04:47:11.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 239 1.25 MB/sec warmup 73 sec latency 2717.542 ms 2024-01-19T04:47:12.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:47:12.354 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:47:12.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 240 1.24 MB/sec warmup 74 sec latency 3415.366 ms 2024-01-19T04:47:13.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 241 1.23 MB/sec warmup 75 sec latency 3478.379 ms 2024-01-19T04:47:14.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 243 1.22 MB/sec warmup 76 sec latency 4453.546 ms 2024-01-19T04:47:15.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 248 1.23 MB/sec warmup 77 sec latency 4003.612 ms 2024-01-19T04:47:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 251 1.22 MB/sec warmup 78 sec latency 2300.531 ms 2024-01-19T04:47:17.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 251 1.21 MB/sec warmup 79 sec latency 2779.559 ms 2024-01-19T04:47:18.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 254 1.20 MB/sec warmup 80 sec latency 3264.965 ms 2024-01-19T04:47:19.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 259 1.21 MB/sec warmup 81 sec latency 3533.538 ms 2024-01-19T04:47:20.629 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:17:08.249 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.629 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:17:08.257 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.741 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:08.351 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.742 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:08.354 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.743 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:08.353 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.746 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:08.357 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.799 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:17:08.427 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 260 1.20 MB/sec warmup 82 sec latency 2600.979 ms 2024-01-19T04:47:20.862 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:08.472 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:20.910 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:08.521 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:47:21.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 261 1.19 MB/sec warmup 83 sec latency 2943.664 ms 2024-01-19T04:47:22.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 263 1.18 MB/sec warmup 84 sec latency 3465.524 ms 2024-01-19T04:47:23.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 266 1.18 MB/sec warmup 85 sec latency 4276.275 ms 2024-01-19T04:47:24.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 268 1.17 MB/sec warmup 86 sec latency 4445.861 ms 2024-01-19T04:47:25.854 INFO:tasks.workunit.client.0.smithi133.stdout: 10 272 1.17 MB/sec warmup 87 sec latency 4094.091 ms 2024-01-19T04:47:26.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 274 1.17 MB/sec warmup 88 sec latency 2934.454 ms 2024-01-19T04:47:27.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 278 1.17 MB/sec warmup 89 sec latency 2728.476 ms 2024-01-19T04:47:28.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 278 1.16 MB/sec warmup 90 sec latency 2989.882 ms 2024-01-19T04:47:29.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 280 1.15 MB/sec warmup 91 sec latency 3824.880 ms 2024-01-19T04:47:30.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 285 1.16 MB/sec warmup 92 sec latency 3842.901 ms 2024-01-19T04:47:31.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 286 1.15 MB/sec warmup 93 sec latency 3290.556 ms 2024-01-19T04:47:32.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 288 1.14 MB/sec warmup 94 sec latency 3064.601 ms 2024-01-19T04:47:33.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 291 1.14 MB/sec warmup 95 sec latency 3233.453 ms 2024-01-19T04:47:34.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 293 1.13 MB/sec warmup 96 sec latency 4024.685 ms 2024-01-19T04:47:35.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 295 1.13 MB/sec warmup 97 sec latency 2805.100 ms 2024-01-19T04:47:36.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 298 1.12 MB/sec warmup 98 sec latency 2904.271 ms 2024-01-19T04:47:37.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 299 1.12 MB/sec warmup 99 sec latency 3046.184 ms 2024-01-19T04:47:38.855 INFO:tasks.workunit.client.0.smithi133.stdout: 10 301 1.11 MB/sec warmup 100 sec latency 3107.992 ms 2024-01-19T04:47:39.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 304 1.11 MB/sec warmup 101 sec latency 3574.111 ms 2024-01-19T04:47:40.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 307 1.11 MB/sec warmup 102 sec latency 3707.005 ms 2024-01-19T04:47:41.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 312 1.11 MB/sec warmup 103 sec latency 2192.411 ms 2024-01-19T04:47:42.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:47:42.401 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:47:42.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 314 1.11 MB/sec warmup 104 sec latency 2194.213 ms 2024-01-19T04:47:43.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 315 1.10 MB/sec warmup 105 sec latency 2489.297 ms 2024-01-19T04:47:44.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 321 1.11 MB/sec warmup 106 sec latency 3038.426 ms 2024-01-19T04:47:45.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 322 1.10 MB/sec warmup 107 sec latency 2973.426 ms 2024-01-19T04:47:46.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 323 1.09 MB/sec warmup 108 sec latency 2367.871 ms 2024-01-19T04:47:47.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 326 1.09 MB/sec warmup 109 sec latency 3367.935 ms 2024-01-19T04:47:48.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 328 1.08 MB/sec warmup 110 sec latency 3839.869 ms 2024-01-19T04:47:49.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 329 1.08 MB/sec warmup 111 sec latency 3103.862 ms 2024-01-19T04:47:50.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 331 1.07 MB/sec warmup 112 sec latency 4103.954 ms 2024-01-19T04:47:51.856 INFO:tasks.workunit.client.0.smithi133.stdout: 10 337 1.08 MB/sec warmup 113 sec latency 5046.541 ms 2024-01-19T04:47:52.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 338 1.07 MB/sec warmup 114 sec latency 1768.476 ms 2024-01-19T04:47:53.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 343 1.08 MB/sec warmup 115 sec latency 2040.000 ms 2024-01-19T04:47:54.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 345 1.07 MB/sec warmup 116 sec latency 1948.554 ms 2024-01-19T04:47:55.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 346 1.07 MB/sec warmup 117 sec latency 2470.162 ms 2024-01-19T04:47:56.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 349 1.06 MB/sec warmup 118 sec latency 2926.507 ms 2024-01-19T04:47:57.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 350 1.06 MB/sec warmup 119 sec latency 2900.855 ms 2024-01-19T04:47:59.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 350 0.00 MB/sec execute 1 sec latency 4589.511 ms 2024-01-19T04:48:00.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 353 0.52 MB/sec execute 2 sec latency 5589.555 ms 2024-01-19T04:48:01.274 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:17:48.903 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.284 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:17:48.913 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.362 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:17:48.991 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.399 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:49.010 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.400 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:49.011 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.404 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:49.014 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.410 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:49.021 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.452 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:17:49.063 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.495 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:49.106 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:48:01.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 357 0.78 MB/sec execute 3 sec latency 6126.603 ms 2024-01-19T04:48:02.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 359 0.72 MB/sec execute 4 sec latency 2652.037 ms 2024-01-19T04:48:03.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 363 0.83 MB/sec execute 5 sec latency 2612.402 ms 2024-01-19T04:48:04.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 365 0.81 MB/sec execute 6 sec latency 3007.522 ms 2024-01-19T04:48:05.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 370 0.93 MB/sec execute 7 sec latency 1971.911 ms 2024-01-19T04:48:06.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 373 0.94 MB/sec execute 8 sec latency 2259.560 ms 2024-01-19T04:48:07.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 373 0.84 MB/sec execute 9 sec latency 2686.955 ms 2024-01-19T04:48:08.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 373 0.75 MB/sec execute 10 sec latency 3687.019 ms 2024-01-19T04:48:09.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 377 0.78 MB/sec execute 11 sec latency 4177.065 ms 2024-01-19T04:48:10.857 INFO:tasks.workunit.client.0.smithi133.stdout: 10 380 0.79 MB/sec execute 12 sec latency 4308.274 ms 2024-01-19T04:48:11.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 382 0.80 MB/sec execute 13 sec latency 2130.652 ms 2024-01-19T04:48:12.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:48:12.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:48:12.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 385 0.80 MB/sec execute 14 sec latency 2594.406 ms 2024-01-19T04:48:13.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 387 0.80 MB/sec execute 15 sec latency 2947.109 ms 2024-01-19T04:48:14.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 393 0.88 MB/sec execute 16 sec latency 3229.221 ms 2024-01-19T04:48:15.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 393 0.83 MB/sec execute 17 sec latency 2056.452 ms 2024-01-19T04:48:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 399 0.87 MB/sec execute 18 sec latency 2171.397 ms 2024-01-19T04:48:17.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 401 0.88 MB/sec execute 19 sec latency 2346.408 ms 2024-01-19T04:48:18.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 401 0.83 MB/sec execute 20 sec latency 2564.544 ms 2024-01-19T04:48:19.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 401 0.79 MB/sec execute 21 sec latency 3564.640 ms 2024-01-19T04:48:20.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 402 0.76 MB/sec execute 22 sec latency 4473.024 ms 2024-01-19T04:48:21.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 408 0.82 MB/sec execute 23 sec latency 4959.746 ms 2024-01-19T04:48:22.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 409 0.80 MB/sec execute 24 sec latency 1866.211 ms 2024-01-19T04:48:23.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 411 0.79 MB/sec execute 25 sec latency 2543.771 ms 2024-01-19T04:48:24.858 INFO:tasks.workunit.client.0.smithi133.stdout: 10 412 0.76 MB/sec execute 26 sec latency 3156.612 ms 2024-01-19T04:48:25.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 419 0.82 MB/sec execute 27 sec latency 3206.750 ms 2024-01-19T04:48:26.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 420 0.81 MB/sec execute 28 sec latency 1713.319 ms 2024-01-19T04:48:27.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 424 0.83 MB/sec execute 29 sec latency 2420.791 ms 2024-01-19T04:48:28.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 426 0.82 MB/sec execute 30 sec latency 2981.344 ms 2024-01-19T04:48:29.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 426 0.80 MB/sec execute 31 sec latency 3981.458 ms 2024-01-19T04:48:30.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 427 0.78 MB/sec execute 32 sec latency 4269.061 ms 2024-01-19T04:48:31.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 427 0.76 MB/sec execute 33 sec latency 5116.468 ms 2024-01-19T04:48:32.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 431 0.77 MB/sec execute 34 sec latency 5265.203 ms 2024-01-19T04:48:33.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 435 0.78 MB/sec execute 35 sec latency 5286.673 ms 2024-01-19T04:48:34.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 435 0.77 MB/sec execute 36 sec latency 2826.170 ms 2024-01-19T04:48:35.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 436 0.75 MB/sec execute 37 sec latency 3744.600 ms 2024-01-19T04:48:36.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 441 0.77 MB/sec execute 38 sec latency 4021.819 ms 2024-01-19T04:48:37.859 INFO:tasks.workunit.client.0.smithi133.stdout: 10 443 0.77 MB/sec execute 39 sec latency 1568.329 ms 2024-01-19T04:48:38.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 443 0.75 MB/sec execute 40 sec latency 2568.444 ms 2024-01-19T04:48:39.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 444 0.74 MB/sec execute 41 sec latency 3568.540 ms 2024-01-19T04:48:40.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 449 0.76 MB/sec execute 42 sec latency 3740.652 ms 2024-01-19T04:48:41.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 452 0.77 MB/sec execute 43 sec latency 2180.364 ms 2024-01-19T04:48:42.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:48:42.612 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:48:42.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 453 0.76 MB/sec execute 44 sec latency 2352.050 ms 2024-01-19T04:48:43.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 455 0.76 MB/sec execute 45 sec latency 3028.463 ms 2024-01-19T04:48:44.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 459 0.77 MB/sec execute 46 sec latency 3656.802 ms 2024-01-19T04:48:45.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 461 0.76 MB/sec execute 47 sec latency 3368.691 ms 2024-01-19T04:48:46.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 464 0.77 MB/sec execute 48 sec latency 3406.412 ms 2024-01-19T04:48:47.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 467 0.77 MB/sec execute 49 sec latency 3065.296 ms 2024-01-19T04:48:48.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 468 0.76 MB/sec execute 50 sec latency 3267.270 ms 2024-01-19T04:48:49.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 471 0.77 MB/sec execute 51 sec latency 3547.847 ms 2024-01-19T04:48:50.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 475 0.78 MB/sec execute 52 sec latency 3572.731 ms 2024-01-19T04:48:51.860 INFO:tasks.workunit.client.0.smithi133.stdout: 10 478 0.79 MB/sec execute 53 sec latency 2423.766 ms 2024-01-19T04:48:52.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 480 0.79 MB/sec execute 54 sec latency 2772.647 ms 2024-01-19T04:48:53.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 481 0.78 MB/sec execute 55 sec latency 3158.875 ms 2024-01-19T04:48:54.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 482 0.77 MB/sec execute 56 sec latency 4158.935 ms 2024-01-19T04:48:55.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 487 0.77 MB/sec execute 57 sec latency 4676.907 ms 2024-01-19T04:48:56.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 495 0.81 MB/sec execute 58 sec latency 3006.861 ms 2024-01-19T04:48:57.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 495 0.80 MB/sec execute 59 sec latency 2211.258 ms 2024-01-19T04:48:58.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 495 0.79 MB/sec execute 60 sec latency 3211.327 ms 2024-01-19T04:48:59.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 499 0.80 MB/sec execute 61 sec latency 4024.486 ms 2024-01-19T04:49:00.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 501 0.79 MB/sec execute 62 sec latency 3920.269 ms 2024-01-19T04:49:01.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 504 0.79 MB/sec execute 63 sec latency 4910.903 ms 2024-01-19T04:49:02.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 504 0.78 MB/sec execute 64 sec latency 5910.953 ms 2024-01-19T04:49:03.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 507 0.79 MB/sec execute 65 sec latency 6911.017 ms 2024-01-19T04:49:04.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 508 0.77 MB/sec execute 66 sec latency 7911.092 ms 2024-01-19T04:49:05.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 510 0.77 MB/sec execute 67 sec latency 8840.880 ms 2024-01-19T04:49:06.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 511 0.76 MB/sec execute 68 sec latency 3836.019 ms 2024-01-19T04:49:07.861 INFO:tasks.workunit.client.0.smithi133.stdout: 10 516 0.77 MB/sec execute 69 sec latency 4382.458 ms 2024-01-19T04:49:08.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 516 0.76 MB/sec execute 70 sec latency 2409.427 ms 2024-01-19T04:49:09.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 520 0.77 MB/sec execute 71 sec latency 2280.856 ms 2024-01-19T04:49:10.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 522 0.77 MB/sec execute 72 sec latency 2638.589 ms 2024-01-19T04:49:11.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 526 0.78 MB/sec execute 73 sec latency 3557.340 ms 2024-01-19T04:49:12.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:49:12.741 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:49:12.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 532 0.79 MB/sec execute 74 sec latency 4557.394 ms 2024-01-19T04:49:13.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 538 0.82 MB/sec execute 75 sec latency 5557.448 ms 2024-01-19T04:49:14.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 544 0.83 MB/sec execute 76 sec latency 5914.143 ms 2024-01-19T04:49:15.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 550 0.84 MB/sec execute 77 sec latency 2833.228 ms 2024-01-19T04:49:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 558 0.85 MB/sec execute 78 sec latency 3017.442 ms 2024-01-19T04:49:17.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 564 0.89 MB/sec execute 79 sec latency 3394.146 ms 2024-01-19T04:49:18.862 INFO:tasks.workunit.client.0.smithi133.stdout: 10 568 0.89 MB/sec execute 80 sec latency 4394.208 ms 2024-01-19T04:49:19.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 576 0.90 MB/sec execute 81 sec latency 4954.059 ms 2024-01-19T04:49:20.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 581 0.92 MB/sec execute 82 sec latency 2993.899 ms 2024-01-19T04:49:21.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 587 0.92 MB/sec execute 83 sec latency 3249.040 ms 2024-01-19T04:49:22.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 597 0.93 MB/sec execute 84 sec latency 3267.428 ms 2024-01-19T04:49:23.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 607 0.97 MB/sec execute 85 sec latency 4267.478 ms 2024-01-19T04:49:24.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 609 0.98 MB/sec execute 86 sec latency 4806.102 ms 2024-01-19T04:49:25.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 610 0.97 MB/sec execute 87 sec latency 4388.624 ms 2024-01-19T04:49:26.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 611 0.96 MB/sec execute 88 sec latency 5304.297 ms 2024-01-19T04:49:27.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 613 0.94 MB/sec execute 89 sec latency 5363.417 ms 2024-01-19T04:49:28.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 614 0.93 MB/sec execute 90 sec latency 3924.454 ms 2024-01-19T04:49:29.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 614 0.92 MB/sec execute 91 sec latency 4924.545 ms 2024-01-19T04:49:30.863 INFO:tasks.workunit.client.0.smithi133.stdout: 10 617 0.91 MB/sec execute 92 sec latency 5073.906 ms 2024-01-19T04:49:31.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 620 0.91 MB/sec execute 93 sec latency 4747.840 ms 2024-01-19T04:49:32.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 627 0.90 MB/sec execute 94 sec latency 4323.627 ms 2024-01-19T04:49:33.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 629 0.89 MB/sec execute 95 sec latency 4384.670 ms 2024-01-19T04:49:34.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 630 0.88 MB/sec execute 96 sec latency 3857.998 ms 2024-01-19T04:49:35.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 630 0.87 MB/sec execute 97 sec latency 3705.574 ms 2024-01-19T04:49:36.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 630 0.86 MB/sec execute 98 sec latency 4705.652 ms 2024-01-19T04:49:37.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 637 0.86 MB/sec execute 99 sec latency 4709.178 ms 2024-01-19T04:49:38.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 639 0.85 MB/sec execute 100 sec latency 4540.560 ms 2024-01-19T04:49:39.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 644 0.84 MB/sec execute 101 sec latency 4665.021 ms 2024-01-19T04:49:40.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 645 0.83 MB/sec execute 102 sec latency 3851.973 ms 2024-01-19T04:49:41.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 648 0.82 MB/sec execute 103 sec latency 4574.046 ms 2024-01-19T04:49:42.864 INFO:tasks.workunit.client.0.smithi133.stdout: 10 648 0.82 MB/sec execute 104 sec latency 1997.883 ms 2024-01-19T04:49:43.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:49:43.024 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:49:43.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 649 0.81 MB/sec execute 105 sec latency 2997.952 ms 2024-01-19T04:49:44.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 650 0.80 MB/sec execute 106 sec latency 3998.046 ms 2024-01-19T04:49:45.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 651 0.79 MB/sec execute 107 sec latency 4991.075 ms 2024-01-19T04:49:46.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 651 0.79 MB/sec execute 108 sec latency 5459.549 ms 2024-01-19T04:49:47.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 652 0.78 MB/sec execute 109 sec latency 5859.914 ms 2024-01-19T04:49:48.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 652 0.77 MB/sec execute 110 sec latency 4927.294 ms 2024-01-19T04:49:49.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 653 0.77 MB/sec execute 111 sec latency 4964.279 ms 2024-01-19T04:49:50.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 656 0.76 MB/sec execute 112 sec latency 4477.571 ms 2024-01-19T04:49:51.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 657 0.75 MB/sec execute 113 sec latency 4900.492 ms 2024-01-19T04:49:52.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 660 0.75 MB/sec execute 114 sec latency 2500.051 ms 2024-01-19T04:49:53.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 661 0.74 MB/sec execute 115 sec latency 3500.105 ms 2024-01-19T04:49:54.865 INFO:tasks.workunit.client.0.smithi133.stdout: 10 663 0.74 MB/sec execute 116 sec latency 4500.154 ms 2024-01-19T04:49:55.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 665 0.73 MB/sec execute 117 sec latency 5500.212 ms 2024-01-19T04:49:56.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 667 0.72 MB/sec execute 118 sec latency 6060.533 ms 2024-01-19T04:49:57.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 668 0.72 MB/sec execute 119 sec latency 5018.706 ms 2024-01-19T04:49:58.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 668 0.71 MB/sec execute 120 sec latency 6018.749 ms 2024-01-19T04:49:59.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 670 0.71 MB/sec execute 121 sec latency 6551.833 ms 2024-01-19T04:50:00.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 674 0.70 MB/sec execute 122 sec latency 5421.345 ms 2024-01-19T04:50:01.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 677 0.70 MB/sec execute 123 sec latency 5286.998 ms 2024-01-19T04:50:02.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 680 0.69 MB/sec execute 124 sec latency 5940.027 ms 2024-01-19T04:50:03.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 681 0.69 MB/sec execute 125 sec latency 3685.775 ms 2024-01-19T04:50:04.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 682 0.68 MB/sec execute 126 sec latency 4685.867 ms 2024-01-19T04:50:05.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 685 0.68 MB/sec execute 127 sec latency 5167.600 ms 2024-01-19T04:50:06.866 INFO:tasks.workunit.client.0.smithi133.stdout: 10 687 0.67 MB/sec execute 128 sec latency 4950.576 ms 2024-01-19T04:50:07.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 690 0.67 MB/sec execute 129 sec latency 5085.031 ms 2024-01-19T04:50:08.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 692 0.66 MB/sec execute 130 sec latency 3216.700 ms 2024-01-19T04:50:09.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 695 0.66 MB/sec execute 131 sec latency 4216.805 ms 2024-01-19T04:50:10.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 696 0.65 MB/sec execute 132 sec latency 4357.759 ms 2024-01-19T04:50:11.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 697 0.65 MB/sec execute 133 sec latency 4794.522 ms 2024-01-19T04:50:12.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 700 0.64 MB/sec execute 134 sec latency 5010.719 ms 2024-01-19T04:50:13.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:50:13.084 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:50:13.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 702 0.64 MB/sec execute 135 sec latency 4347.402 ms 2024-01-19T04:50:14.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 704 0.63 MB/sec execute 136 sec latency 4786.140 ms 2024-01-19T04:50:15.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 706 0.63 MB/sec execute 137 sec latency 5700.305 ms 2024-01-19T04:50:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 709 0.63 MB/sec execute 138 sec latency 3301.426 ms 2024-01-19T04:50:17.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 712 0.62 MB/sec execute 139 sec latency 4301.468 ms 2024-01-19T04:50:18.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 713 0.62 MB/sec execute 140 sec latency 5301.524 ms 2024-01-19T04:50:19.867 INFO:tasks.workunit.client.0.smithi133.stdout: 10 715 0.61 MB/sec execute 141 sec latency 5694.648 ms 2024-01-19T04:50:20.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 717 0.61 MB/sec execute 142 sec latency 3763.026 ms 2024-01-19T04:50:21.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 721 0.61 MB/sec execute 143 sec latency 4244.616 ms 2024-01-19T04:50:22.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 723 0.60 MB/sec execute 144 sec latency 3844.476 ms 2024-01-19T04:50:23.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 724 0.60 MB/sec execute 145 sec latency 2378.568 ms 2024-01-19T04:50:24.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 725 0.59 MB/sec execute 146 sec latency 3104.536 ms 2024-01-19T04:50:25.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 728 0.59 MB/sec execute 147 sec latency 3158.134 ms 2024-01-19T04:50:26.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 731 0.59 MB/sec execute 148 sec latency 3354.307 ms 2024-01-19T04:50:27.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 735 0.59 MB/sec execute 149 sec latency 4354.392 ms 2024-01-19T04:50:28.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 737 0.58 MB/sec execute 150 sec latency 5354.455 ms 2024-01-19T04:50:29.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 737 0.58 MB/sec execute 151 sec latency 6354.512 ms 2024-01-19T04:50:30.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 738 0.57 MB/sec execute 152 sec latency 7354.562 ms 2024-01-19T04:50:31.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 741 0.57 MB/sec execute 153 sec latency 8354.619 ms 2024-01-19T04:50:32.868 INFO:tasks.workunit.client.0.smithi133.stdout: 10 743 0.57 MB/sec execute 154 sec latency 8487.646 ms 2024-01-19T04:50:33.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 746 0.56 MB/sec execute 155 sec latency 5659.229 ms 2024-01-19T04:50:34.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 748 0.56 MB/sec execute 156 sec latency 6659.285 ms 2024-01-19T04:50:35.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 750 0.56 MB/sec execute 157 sec latency 7306.889 ms 2024-01-19T04:50:36.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 751 0.55 MB/sec execute 158 sec latency 4758.543 ms 2024-01-19T04:50:37.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 753 0.55 MB/sec execute 159 sec latency 5255.411 ms 2024-01-19T04:50:38.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 754 0.55 MB/sec execute 160 sec latency 5002.651 ms 2024-01-19T04:50:39.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 754 0.54 MB/sec execute 161 sec latency 5498.006 ms 2024-01-19T04:50:40.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 755 0.54 MB/sec execute 162 sec latency 5575.209 ms 2024-01-19T04:50:41.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 756 0.54 MB/sec execute 163 sec latency 5728.269 ms 2024-01-19T04:50:42.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 761 0.54 MB/sec execute 164 sec latency 4962.371 ms 2024-01-19T04:50:43.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:50:43.150 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:50:43.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 765 0.53 MB/sec execute 165 sec latency 5106.609 ms 2024-01-19T04:50:44.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 770 0.53 MB/sec execute 166 sec latency 3366.163 ms 2024-01-19T04:50:45.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 774 0.53 MB/sec execute 167 sec latency 1191.270 ms 2024-01-19T04:50:46.869 INFO:tasks.workunit.client.0.smithi133.stdout: 10 778 0.52 MB/sec execute 168 sec latency 1935.437 ms 2024-01-19T04:50:47.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 781 0.52 MB/sec execute 169 sec latency 1834.589 ms 2024-01-19T04:50:48.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 782 0.52 MB/sec execute 170 sec latency 2326.969 ms 2024-01-19T04:50:49.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 783 0.52 MB/sec execute 171 sec latency 2981.967 ms 2024-01-19T04:50:50.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 784 0.51 MB/sec execute 172 sec latency 3828.971 ms 2024-01-19T04:50:51.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 786 0.51 MB/sec execute 173 sec latency 4829.015 ms 2024-01-19T04:50:52.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 788 0.51 MB/sec execute 174 sec latency 5829.106 ms 2024-01-19T04:50:53.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 789 0.51 MB/sec execute 175 sec latency 6829.205 ms 2024-01-19T04:50:54.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 791 0.50 MB/sec execute 176 sec latency 7446.454 ms 2024-01-19T04:50:55.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 795 0.50 MB/sec execute 177 sec latency 5538.836 ms 2024-01-19T04:50:56.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 798 0.50 MB/sec execute 178 sec latency 6201.113 ms 2024-01-19T04:50:57.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 801 0.50 MB/sec execute 179 sec latency 3278.827 ms 2024-01-19T04:50:58.870 INFO:tasks.workunit.client.0.smithi133.stdout: 10 806 0.49 MB/sec execute 180 sec latency 4278.899 ms 2024-01-19T04:50:59.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 807 0.49 MB/sec execute 181 sec latency 5278.982 ms 2024-01-19T04:51:00.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 809 0.49 MB/sec execute 182 sec latency 6279.032 ms 2024-01-19T04:51:01.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 811 0.49 MB/sec execute 183 sec latency 7272.758 ms 2024-01-19T04:51:02.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 815 0.48 MB/sec execute 184 sec latency 6338.207 ms 2024-01-19T04:51:03.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 816 0.48 MB/sec execute 185 sec latency 6621.061 ms 2024-01-19T04:51:04.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 816 0.48 MB/sec execute 186 sec latency 4823.109 ms 2024-01-19T04:51:05.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 816 0.48 MB/sec execute 187 sec latency 5663.801 ms 2024-01-19T04:51:06.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 817 0.47 MB/sec execute 188 sec latency 5196.672 ms 2024-01-19T04:51:07.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 817 0.47 MB/sec execute 189 sec latency 4572.443 ms 2024-01-19T04:51:08.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 817 0.47 MB/sec execute 190 sec latency 4654.195 ms 2024-01-19T04:51:09.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 818 0.47 MB/sec execute 191 sec latency 4159.725 ms 2024-01-19T04:51:10.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 818 0.46 MB/sec execute 192 sec latency 4942.052 ms 2024-01-19T04:51:11.871 INFO:tasks.workunit.client.0.smithi133.stdout: 10 819 0.46 MB/sec execute 193 sec latency 4642.948 ms 2024-01-19T04:51:12.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 821 0.46 MB/sec execute 194 sec latency 4821.184 ms 2024-01-19T04:51:13.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:51:13.266 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:51:13.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 825 0.46 MB/sec execute 195 sec latency 3910.850 ms 2024-01-19T04:51:14.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 825 0.46 MB/sec execute 196 sec latency 2801.067 ms 2024-01-19T04:51:15.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 825 0.45 MB/sec execute 197 sec latency 3801.133 ms 2024-01-19T04:51:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 826 0.45 MB/sec execute 198 sec latency 4690.599 ms 2024-01-19T04:51:17.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 827 0.45 MB/sec execute 199 sec latency 4628.116 ms 2024-01-19T04:51:18.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 830 0.45 MB/sec execute 200 sec latency 4420.343 ms 2024-01-19T04:51:19.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 830 0.44 MB/sec execute 201 sec latency 2834.754 ms 2024-01-19T04:51:20.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 831 0.44 MB/sec execute 202 sec latency 3414.719 ms 2024-01-19T04:51:21.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 834 0.44 MB/sec execute 203 sec latency 3876.433 ms 2024-01-19T04:51:22.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 836 0.44 MB/sec execute 204 sec latency 4523.893 ms 2024-01-19T04:51:23.872 INFO:tasks.workunit.client.0.smithi133.stdout: 10 853 0.44 MB/sec execute 205 sec latency 2308.515 ms 2024-01-19T04:51:24.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 855 0.44 MB/sec execute 206 sec latency 2993.453 ms 2024-01-19T04:51:25.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 857 0.44 MB/sec execute 207 sec latency 1633.094 ms 2024-01-19T04:51:26.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 857 0.43 MB/sec execute 208 sec latency 2633.192 ms 2024-01-19T04:51:27.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 857 0.43 MB/sec execute 209 sec latency 3633.252 ms 2024-01-19T04:51:28.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 859 0.43 MB/sec execute 210 sec latency 4315.484 ms 2024-01-19T04:51:29.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 859 0.43 MB/sec execute 211 sec latency 5136.133 ms 2024-01-19T04:51:30.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 861 0.43 MB/sec execute 212 sec latency 5735.130 ms 2024-01-19T04:51:31.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 862 0.42 MB/sec execute 213 sec latency 2088.765 ms 2024-01-19T04:51:32.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 863 0.42 MB/sec execute 214 sec latency 3088.816 ms 2024-01-19T04:51:33.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 864 0.42 MB/sec execute 215 sec latency 4088.902 ms 2024-01-19T04:51:34.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 864 0.42 MB/sec execute 216 sec latency 4808.714 ms 2024-01-19T04:51:35.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 865 0.42 MB/sec execute 217 sec latency 5252.567 ms 2024-01-19T04:51:36.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 867 0.41 MB/sec execute 218 sec latency 5405.201 ms 2024-01-19T04:51:37.873 INFO:tasks.workunit.client.0.smithi133.stdout: 10 869 0.41 MB/sec execute 219 sec latency 3417.177 ms 2024-01-19T04:51:38.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 871 0.41 MB/sec execute 220 sec latency 3550.676 ms 2024-01-19T04:51:39.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 872 0.41 MB/sec execute 221 sec latency 2812.156 ms 2024-01-19T04:51:40.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 873 0.41 MB/sec execute 222 sec latency 3812.223 ms 2024-01-19T04:51:41.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 874 0.41 MB/sec execute 223 sec latency 4812.313 ms 2024-01-19T04:51:42.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 874 0.40 MB/sec execute 224 sec latency 5812.366 ms 2024-01-19T04:51:43.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:51:43.403 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:51:43.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 874 0.40 MB/sec execute 225 sec latency 6060.907 ms 2024-01-19T04:51:44.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 875 0.40 MB/sec execute 226 sec latency 6801.830 ms 2024-01-19T04:51:45.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 877 0.40 MB/sec execute 227 sec latency 6134.330 ms 2024-01-19T04:51:46.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 880 0.40 MB/sec execute 228 sec latency 4689.119 ms 2024-01-19T04:51:47.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 884 0.40 MB/sec execute 229 sec latency 1248.121 ms 2024-01-19T04:51:48.874 INFO:tasks.workunit.client.0.smithi133.stdout: 10 887 0.40 MB/sec execute 230 sec latency 2211.713 ms 2024-01-19T04:51:49.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 888 0.39 MB/sec execute 231 sec latency 3211.788 ms 2024-01-19T04:51:50.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 890 0.39 MB/sec execute 232 sec latency 4109.557 ms 2024-01-19T04:51:51.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 892 0.39 MB/sec execute 233 sec latency 5109.638 ms 2024-01-19T04:51:52.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 892 0.39 MB/sec execute 234 sec latency 6109.703 ms 2024-01-19T04:51:53.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 893 0.39 MB/sec execute 235 sec latency 6504.265 ms 2024-01-19T04:51:54.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 894 0.39 MB/sec execute 236 sec latency 6026.791 ms 2024-01-19T04:51:55.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 899 0.38 MB/sec execute 237 sec latency 3755.938 ms 2024-01-19T04:51:56.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 902 0.38 MB/sec execute 238 sec latency 2601.487 ms 2024-01-19T04:51:57.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 904 0.38 MB/sec execute 239 sec latency 1600.187 ms 2024-01-19T04:51:58.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 906 0.38 MB/sec execute 240 sec latency 2329.158 ms 2024-01-19T04:51:59.875 INFO:tasks.workunit.client.0.smithi133.stdout: 10 909 0.38 MB/sec execute 241 sec latency 2644.844 ms 2024-01-19T04:52:00.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 910 0.38 MB/sec execute 242 sec latency 3644.942 ms 2024-01-19T04:52:01.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 911 0.38 MB/sec execute 243 sec latency 4645.001 ms 2024-01-19T04:52:02.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 911 0.37 MB/sec execute 244 sec latency 5645.066 ms 2024-01-19T04:52:03.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 912 0.37 MB/sec execute 245 sec latency 6645.134 ms 2024-01-19T04:52:04.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 916 0.37 MB/sec execute 246 sec latency 6788.289 ms 2024-01-19T04:52:05.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 921 0.37 MB/sec execute 247 sec latency 5508.409 ms 2024-01-19T04:52:06.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 924 0.37 MB/sec execute 248 sec latency 5953.341 ms 2024-01-19T04:52:07.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 926 0.37 MB/sec execute 249 sec latency 4589.877 ms 2024-01-19T04:52:08.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 928 0.37 MB/sec execute 250 sec latency 3908.261 ms 2024-01-19T04:52:09.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 929 0.37 MB/sec execute 251 sec latency 3575.385 ms 2024-01-19T04:52:10.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 930 0.37 MB/sec execute 252 sec latency 4575.482 ms 2024-01-19T04:52:11.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 931 0.36 MB/sec execute 253 sec latency 5575.551 ms 2024-01-19T04:52:12.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 932 0.36 MB/sec execute 254 sec latency 5814.552 ms 2024-01-19T04:52:13.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:52:13.527 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:52:13.876 INFO:tasks.workunit.client.0.smithi133.stdout: 10 932 0.36 MB/sec execute 255 sec latency 4561.519 ms 2024-01-19T04:52:14.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 932 0.36 MB/sec execute 256 sec latency 5561.594 ms 2024-01-19T04:52:15.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 933 0.36 MB/sec execute 257 sec latency 6561.670 ms 2024-01-19T04:52:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 934 0.36 MB/sec execute 258 sec latency 6628.904 ms 2024-01-19T04:52:17.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 936 0.36 MB/sec execute 259 sec latency 4723.607 ms 2024-01-19T04:52:18.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 936 0.35 MB/sec execute 260 sec latency 2932.986 ms 2024-01-19T04:52:19.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 936 0.35 MB/sec execute 261 sec latency 3933.044 ms 2024-01-19T04:52:20.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 936 0.35 MB/sec execute 262 sec latency 4933.113 ms 2024-01-19T04:52:21.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 938 0.35 MB/sec execute 263 sec latency 5235.497 ms 2024-01-19T04:52:22.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 939 0.35 MB/sec execute 264 sec latency 4105.557 ms 2024-01-19T04:52:23.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 941 0.35 MB/sec execute 265 sec latency 2394.827 ms 2024-01-19T04:52:24.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 943 0.35 MB/sec execute 266 sec latency 3394.918 ms 2024-01-19T04:52:25.877 INFO:tasks.workunit.client.0.smithi133.stdout: 10 945 0.35 MB/sec execute 267 sec latency 4248.622 ms 2024-01-19T04:52:26.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 945 0.35 MB/sec execute 268 sec latency 3341.770 ms 2024-01-19T04:52:27.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 946 0.35 MB/sec execute 269 sec latency 4341.861 ms 2024-01-19T04:52:28.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 947 0.35 MB/sec execute 270 sec latency 4656.030 ms 2024-01-19T04:52:29.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 948 0.34 MB/sec execute 271 sec latency 4462.534 ms 2024-01-19T04:52:30.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 949 0.34 MB/sec execute 272 sec latency 4873.914 ms 2024-01-19T04:52:31.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 951 0.34 MB/sec execute 273 sec latency 5427.344 ms 2024-01-19T04:52:32.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 951 0.34 MB/sec execute 274 sec latency 4795.314 ms 2024-01-19T04:52:33.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 954 0.34 MB/sec execute 275 sec latency 4960.384 ms 2024-01-19T04:52:34.878 INFO:tasks.workunit.client.0.smithi133.stdout: 10 955 0.34 MB/sec execute 276 sec latency 4361.262 ms 2024-01-19T04:52:35.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 958 0.34 MB/sec execute 277 sec latency 4276.022 ms 2024-01-19T04:52:36.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 959 0.34 MB/sec execute 278 sec latency 5016.807 ms 2024-01-19T04:52:37.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 959 0.34 MB/sec execute 279 sec latency 4466.066 ms 2024-01-19T04:52:38.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 963 0.34 MB/sec execute 280 sec latency 5041.736 ms 2024-01-19T04:52:39.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 966 0.34 MB/sec execute 281 sec latency 4483.105 ms 2024-01-19T04:52:40.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 968 0.33 MB/sec execute 282 sec latency 1954.063 ms 2024-01-19T04:52:41.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 969 0.33 MB/sec execute 283 sec latency 2954.127 ms 2024-01-19T04:52:42.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 969 0.33 MB/sec execute 284 sec latency 3954.218 ms 2024-01-19T04:52:43.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:52:43.571 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:52:43.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 973 0.33 MB/sec execute 285 sec latency 4610.792 ms 2024-01-19T04:52:44.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 976 0.33 MB/sec execute 286 sec latency 4703.548 ms 2024-01-19T04:52:45.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 979 0.33 MB/sec execute 287 sec latency 3311.861 ms 2024-01-19T04:52:46.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 982 0.33 MB/sec execute 288 sec latency 2907.438 ms 2024-01-19T04:52:47.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 986 0.33 MB/sec execute 289 sec latency 3907.507 ms 2024-01-19T04:52:48.879 INFO:tasks.workunit.client.0.smithi133.stdout: 10 991 0.33 MB/sec execute 290 sec latency 4098.809 ms 2024-01-19T04:52:49.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 992 0.33 MB/sec execute 291 sec latency 1808.856 ms 2024-01-19T04:52:50.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 992 0.33 MB/sec execute 292 sec latency 2808.949 ms 2024-01-19T04:52:51.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 993 0.33 MB/sec execute 293 sec latency 3809.011 ms 2024-01-19T04:52:52.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 993 0.33 MB/sec execute 294 sec latency 4809.091 ms 2024-01-19T04:52:53.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 993 0.32 MB/sec execute 295 sec latency 5809.149 ms 2024-01-19T04:52:54.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 995 0.32 MB/sec execute 296 sec latency 6809.212 ms 2024-01-19T04:52:55.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 997 0.32 MB/sec execute 297 sec latency 7372.058 ms 2024-01-19T04:52:56.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1000 0.32 MB/sec execute 298 sec latency 7684.974 ms 2024-01-19T04:52:57.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1004 0.32 MB/sec execute 299 sec latency 6155.977 ms 2024-01-19T04:52:58.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1008 0.32 MB/sec execute 300 sec latency 2678.054 ms 2024-01-19T04:52:59.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1011 0.32 MB/sec execute 301 sec latency 3248.075 ms 2024-01-19T04:53:00.880 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1013 0.32 MB/sec execute 302 sec latency 2583.104 ms 2024-01-19T04:53:01.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1013 0.32 MB/sec execute 303 sec latency 3583.199 ms 2024-01-19T04:53:02.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1013 0.32 MB/sec execute 304 sec latency 4583.284 ms 2024-01-19T04:53:03.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1013 0.32 MB/sec execute 305 sec latency 5583.354 ms 2024-01-19T04:53:04.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1013 0.32 MB/sec execute 306 sec latency 5829.730 ms 2024-01-19T04:53:05.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1016 0.32 MB/sec execute 307 sec latency 6365.107 ms 2024-01-19T04:53:06.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1019 0.32 MB/sec execute 308 sec latency 6168.461 ms 2024-01-19T04:53:07.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1024 0.32 MB/sec execute 309 sec latency 1572.996 ms 2024-01-19T04:53:08.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1030 0.32 MB/sec execute 310 sec latency 2152.504 ms 2024-01-19T04:53:09.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1038 0.33 MB/sec execute 311 sec latency 3152.560 ms 2024-01-19T04:53:10.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1039 0.33 MB/sec execute 312 sec latency 4152.653 ms 2024-01-19T04:53:11.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1039 0.33 MB/sec execute 313 sec latency 5080.992 ms 2024-01-19T04:53:12.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1039 0.33 MB/sec execute 314 sec latency 4364.187 ms 2024-01-19T04:53:13.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1040 0.33 MB/sec execute 315 sec latency 5364.236 ms 2024-01-19T04:53:13.911 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:53:13.914 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:53:14.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1042 0.33 MB/sec execute 316 sec latency 5590.337 ms 2024-01-19T04:53:15.881 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1043 0.33 MB/sec execute 317 sec latency 4071.935 ms 2024-01-19T04:53:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1045 0.32 MB/sec execute 318 sec latency 5071.994 ms 2024-01-19T04:53:17.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1046 0.32 MB/sec execute 319 sec latency 5465.786 ms 2024-01-19T04:53:18.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1048 0.32 MB/sec execute 320 sec latency 2030.724 ms 2024-01-19T04:53:19.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1048 0.32 MB/sec execute 321 sec latency 3030.801 ms 2024-01-19T04:53:20.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1048 0.32 MB/sec execute 322 sec latency 4030.873 ms 2024-01-19T04:53:21.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1049 0.32 MB/sec execute 323 sec latency 4371.880 ms 2024-01-19T04:53:22.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1052 0.32 MB/sec execute 324 sec latency 4510.450 ms 2024-01-19T04:53:23.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1054 0.32 MB/sec execute 325 sec latency 2029.057 ms 2024-01-19T04:53:24.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1057 0.32 MB/sec execute 326 sec latency 3029.143 ms 2024-01-19T04:53:25.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1057 0.32 MB/sec execute 327 sec latency 4029.231 ms 2024-01-19T04:53:26.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1058 0.31 MB/sec execute 328 sec latency 5029.305 ms 2024-01-19T04:53:27.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1060 0.31 MB/sec execute 329 sec latency 5134.243 ms 2024-01-19T04:53:28.882 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1060 0.31 MB/sec execute 330 sec latency 5726.834 ms 2024-01-19T04:53:29.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1061 0.31 MB/sec execute 331 sec latency 5463.941 ms 2024-01-19T04:53:30.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1064 0.31 MB/sec execute 332 sec latency 5740.829 ms 2024-01-19T04:53:31.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1065 0.31 MB/sec execute 333 sec latency 5301.948 ms 2024-01-19T04:53:32.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1066 0.31 MB/sec execute 334 sec latency 5119.369 ms 2024-01-19T04:53:33.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1066 0.31 MB/sec execute 335 sec latency 4421.214 ms 2024-01-19T04:53:34.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1067 0.31 MB/sec execute 336 sec latency 5421.276 ms 2024-01-19T04:53:35.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1069 0.31 MB/sec execute 337 sec latency 5586.939 ms 2024-01-19T04:53:36.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1070 0.31 MB/sec execute 338 sec latency 5139.764 ms 2024-01-19T04:53:37.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1071 0.30 MB/sec execute 339 sec latency 4893.886 ms 2024-01-19T04:53:38.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1073 0.30 MB/sec execute 340 sec latency 3747.845 ms 2024-01-19T04:53:39.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1076 0.30 MB/sec execute 341 sec latency 4236.291 ms 2024-01-19T04:53:40.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1077 0.30 MB/sec execute 342 sec latency 4293.280 ms 2024-01-19T04:53:41.883 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1078 0.30 MB/sec execute 343 sec latency 4852.701 ms 2024-01-19T04:53:42.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1081 0.30 MB/sec execute 344 sec latency 3770.506 ms 2024-01-19T04:53:43.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1083 0.30 MB/sec execute 345 sec latency 4770.597 ms 2024-01-19T04:53:43.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:53:43.966 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:53:44.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1085 0.30 MB/sec execute 346 sec latency 5415.735 ms 2024-01-19T04:53:45.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1087 0.30 MB/sec execute 347 sec latency 5792.982 ms 2024-01-19T04:53:46.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1089 0.30 MB/sec execute 348 sec latency 5049.097 ms 2024-01-19T04:53:47.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1091 0.30 MB/sec execute 349 sec latency 1284.319 ms 2024-01-19T04:53:48.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1094 0.30 MB/sec execute 350 sec latency 1640.666 ms 2024-01-19T04:53:49.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1096 0.30 MB/sec execute 351 sec latency 2366.072 ms 2024-01-19T04:53:50.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1096 0.29 MB/sec execute 352 sec latency 3366.167 ms 2024-01-19T04:53:51.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1096 0.29 MB/sec execute 353 sec latency 4366.240 ms 2024-01-19T04:53:52.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1097 0.29 MB/sec execute 354 sec latency 5366.315 ms 2024-01-19T04:53:53.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1101 0.29 MB/sec execute 355 sec latency 6366.372 ms 2024-01-19T04:53:54.884 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1105 0.29 MB/sec execute 356 sec latency 6949.696 ms 2024-01-19T04:53:55.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1105 0.29 MB/sec execute 357 sec latency 7172.079 ms 2024-01-19T04:53:56.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1108 0.29 MB/sec execute 358 sec latency 4963.395 ms 2024-01-19T04:53:57.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1111 0.29 MB/sec execute 359 sec latency 3410.473 ms 2024-01-19T04:53:58.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1113 0.29 MB/sec execute 360 sec latency 4313.488 ms 2024-01-19T04:53:59.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1113 0.29 MB/sec execute 361 sec latency 3445.648 ms 2024-01-19T04:54:00.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1114 0.29 MB/sec execute 362 sec latency 4293.711 ms 2024-01-19T04:54:01.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1115 0.29 MB/sec execute 363 sec latency 4972.190 ms 2024-01-19T04:54:02.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1118 0.29 MB/sec execute 364 sec latency 4785.169 ms 2024-01-19T04:54:03.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1120 0.28 MB/sec execute 365 sec latency 5043.100 ms 2024-01-19T04:54:04.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1122 0.28 MB/sec execute 366 sec latency 4587.747 ms 2024-01-19T04:54:05.885 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1125 0.28 MB/sec execute 367 sec latency 3600.126 ms 2024-01-19T04:54:06.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1125 0.28 MB/sec execute 368 sec latency 4600.209 ms 2024-01-19T04:54:07.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1126 0.28 MB/sec execute 369 sec latency 5340.713 ms 2024-01-19T04:54:08.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1128 0.28 MB/sec execute 370 sec latency 4493.794 ms 2024-01-19T04:54:09.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1131 0.28 MB/sec execute 371 sec latency 4292.619 ms 2024-01-19T04:54:10.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1134 0.28 MB/sec execute 372 sec latency 4337.299 ms 2024-01-19T04:54:11.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1135 0.28 MB/sec execute 373 sec latency 4660.418 ms 2024-01-19T04:54:12.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1137 0.28 MB/sec execute 374 sec latency 4697.518 ms 2024-01-19T04:54:13.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1140 0.28 MB/sec execute 375 sec latency 3437.161 ms 2024-01-19T04:54:14.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:54:14.065 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:54:14.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1142 0.28 MB/sec execute 376 sec latency 4219.368 ms 2024-01-19T04:54:15.179 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:24:02.806 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.200 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:24:02.827 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.241 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:02.851 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.245 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:24:02.856 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.258 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:02.868 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.268 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:24:02.879 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.435 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:24:03.062 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.487 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:03.097 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.583 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:24:03.194 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:54:15.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1144 0.28 MB/sec execute 377 sec latency 4584.726 ms 2024-01-19T04:54:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1147 0.28 MB/sec execute 378 sec latency 3293.043 ms 2024-01-19T04:54:17.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1150 0.28 MB/sec execute 379 sec latency 3381.479 ms 2024-01-19T04:54:18.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1152 0.27 MB/sec execute 380 sec latency 3517.572 ms 2024-01-19T04:54:19.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1155 0.27 MB/sec execute 381 sec latency 3951.870 ms 2024-01-19T04:54:20.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1157 0.27 MB/sec execute 382 sec latency 4951.948 ms 2024-01-19T04:54:21.886 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1159 0.27 MB/sec execute 383 sec latency 5403.035 ms 2024-01-19T04:54:22.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1161 0.27 MB/sec execute 384 sec latency 4864.306 ms 2024-01-19T04:54:23.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1163 0.27 MB/sec execute 385 sec latency 5651.634 ms 2024-01-19T04:54:24.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1165 0.27 MB/sec execute 386 sec latency 4073.291 ms 2024-01-19T04:54:25.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1167 0.27 MB/sec execute 387 sec latency 4182.773 ms 2024-01-19T04:54:26.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1167 0.27 MB/sec execute 388 sec latency 5182.833 ms 2024-01-19T04:54:27.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1169 0.27 MB/sec execute 389 sec latency 5984.860 ms 2024-01-19T04:54:28.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1172 0.27 MB/sec execute 390 sec latency 5133.618 ms 2024-01-19T04:54:29.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1174 0.27 MB/sec execute 391 sec latency 5524.644 ms 2024-01-19T04:54:30.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1174 0.27 MB/sec execute 392 sec latency 6524.719 ms 2024-01-19T04:54:31.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1175 0.27 MB/sec execute 393 sec latency 7524.820 ms 2024-01-19T04:54:32.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1176 0.27 MB/sec execute 394 sec latency 7719.839 ms 2024-01-19T04:54:33.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1178 0.26 MB/sec execute 395 sec latency 5653.333 ms 2024-01-19T04:54:34.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1178 0.26 MB/sec execute 396 sec latency 6653.390 ms 2024-01-19T04:54:35.887 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1179 0.26 MB/sec execute 397 sec latency 7206.084 ms 2024-01-19T04:54:36.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1181 0.26 MB/sec execute 398 sec latency 4653.578 ms 2024-01-19T04:54:37.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1184 0.26 MB/sec execute 399 sec latency 4226.938 ms 2024-01-19T04:54:38.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1185 0.26 MB/sec execute 400 sec latency 4750.170 ms 2024-01-19T04:54:39.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1188 0.26 MB/sec execute 401 sec latency 4055.445 ms 2024-01-19T04:54:40.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1188 0.26 MB/sec execute 402 sec latency 4432.645 ms 2024-01-19T04:54:41.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1189 0.26 MB/sec execute 403 sec latency 5369.820 ms 2024-01-19T04:54:42.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1191 0.26 MB/sec execute 404 sec latency 4003.664 ms 2024-01-19T04:54:43.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1192 0.26 MB/sec execute 405 sec latency 4986.661 ms 2024-01-19T04:54:44.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:54:44.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:54:44.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1192 0.26 MB/sec execute 406 sec latency 5392.662 ms 2024-01-19T04:54:45.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1194 0.26 MB/sec execute 407 sec latency 5624.064 ms 2024-01-19T04:54:46.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1195 0.26 MB/sec execute 408 sec latency 3228.829 ms 2024-01-19T04:54:47.888 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1197 0.26 MB/sec execute 409 sec latency 4228.908 ms 2024-01-19T04:54:48.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1200 0.26 MB/sec execute 410 sec latency 5017.473 ms 2024-01-19T04:54:49.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1201 0.25 MB/sec execute 411 sec latency 5210.518 ms 2024-01-19T04:54:50.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1202 0.25 MB/sec execute 412 sec latency 4952.187 ms 2024-01-19T04:54:51.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1202 0.25 MB/sec execute 413 sec latency 3591.804 ms 2024-01-19T04:54:52.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1203 0.25 MB/sec execute 414 sec latency 4591.872 ms 2024-01-19T04:54:53.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1203 0.25 MB/sec execute 415 sec latency 5543.383 ms 2024-01-19T04:54:54.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1208 0.25 MB/sec execute 416 sec latency 5594.705 ms 2024-01-19T04:54:55.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1210 0.25 MB/sec execute 417 sec latency 5151.199 ms 2024-01-19T04:54:56.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1211 0.25 MB/sec execute 418 sec latency 3048.748 ms 2024-01-19T04:54:57.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1214 0.25 MB/sec execute 419 sec latency 3915.934 ms 2024-01-19T04:54:58.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1215 0.25 MB/sec execute 420 sec latency 3461.974 ms 2024-01-19T04:54:59.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1215 0.25 MB/sec execute 421 sec latency 4462.073 ms 2024-01-19T04:55:00.889 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1216 0.25 MB/sec execute 422 sec latency 5239.257 ms 2024-01-19T04:55:01.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1218 0.25 MB/sec execute 423 sec latency 4111.724 ms 2024-01-19T04:55:02.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1218 0.25 MB/sec execute 424 sec latency 5111.821 ms 2024-01-19T04:55:03.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1219 0.25 MB/sec execute 425 sec latency 6111.881 ms 2024-01-19T04:55:04.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1226 0.25 MB/sec execute 426 sec latency 6429.245 ms 2024-01-19T04:55:05.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1232 0.25 MB/sec execute 427 sec latency 1056.460 ms 2024-01-19T04:55:06.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1239 0.25 MB/sec execute 428 sec latency 1985.473 ms 2024-01-19T04:55:07.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1242 0.25 MB/sec execute 429 sec latency 2985.535 ms 2024-01-19T04:55:08.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1243 0.25 MB/sec execute 430 sec latency 3985.595 ms 2024-01-19T04:55:09.636 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:24:57.262 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.640 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:24:57.267 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.708 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:24:57.335 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.712 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:57.322 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.755 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:57.365 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.806 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:57.416 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.811 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:24:57.422 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.822 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:24:57.434 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:09.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1244 0.25 MB/sec execute 431 sec latency 4985.650 ms 2024-01-19T04:55:09.899 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:24:57.510 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:55:10.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1246 0.25 MB/sec execute 432 sec latency 5930.772 ms 2024-01-19T04:55:11.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1248 0.25 MB/sec execute 433 sec latency 6190.228 ms 2024-01-19T04:55:12.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1257 0.26 MB/sec execute 434 sec latency 5404.378 ms 2024-01-19T04:55:13.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1260 0.25 MB/sec execute 435 sec latency 4874.453 ms 2024-01-19T04:55:14.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:55:14.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:55:14.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1262 0.25 MB/sec execute 436 sec latency 3293.129 ms 2024-01-19T04:55:15.890 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1265 0.25 MB/sec execute 437 sec latency 4293.183 ms 2024-01-19T04:55:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1265 0.25 MB/sec execute 438 sec latency 5293.266 ms 2024-01-19T04:55:17.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1265 0.25 MB/sec execute 439 sec latency 6293.362 ms 2024-01-19T04:55:18.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1266 0.25 MB/sec execute 440 sec latency 6732.110 ms 2024-01-19T04:55:19.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1266 0.25 MB/sec execute 441 sec latency 7044.663 ms 2024-01-19T04:55:20.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1269 0.25 MB/sec execute 442 sec latency 7671.363 ms 2024-01-19T04:55:21.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1271 0.25 MB/sec execute 443 sec latency 7522.188 ms 2024-01-19T04:55:22.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1272 0.25 MB/sec execute 444 sec latency 5703.020 ms 2024-01-19T04:55:23.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1274 0.25 MB/sec execute 445 sec latency 6292.823 ms 2024-01-19T04:55:24.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1274 0.25 MB/sec execute 446 sec latency 4373.644 ms 2024-01-19T04:55:25.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1277 0.25 MB/sec execute 447 sec latency 4720.121 ms 2024-01-19T04:55:26.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1280 0.25 MB/sec execute 448 sec latency 4618.894 ms 2024-01-19T04:55:27.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1282 0.25 MB/sec execute 449 sec latency 4264.431 ms 2024-01-19T04:55:28.891 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1284 0.25 MB/sec execute 450 sec latency 5173.326 ms 2024-01-19T04:55:29.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1285 0.25 MB/sec execute 451 sec latency 4251.195 ms 2024-01-19T04:55:30.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1287 0.25 MB/sec execute 452 sec latency 4440.657 ms 2024-01-19T04:55:31.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1289 0.25 MB/sec execute 453 sec latency 4507.551 ms 2024-01-19T04:55:32.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1291 0.25 MB/sec execute 454 sec latency 5507.646 ms 2024-01-19T04:55:33.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1297 0.25 MB/sec execute 455 sec latency 6507.717 ms 2024-01-19T04:55:34.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1297 0.25 MB/sec execute 456 sec latency 7269.692 ms 2024-01-19T04:55:35.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1299 0.25 MB/sec execute 457 sec latency 6983.380 ms 2024-01-19T04:55:36.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1299 0.25 MB/sec execute 458 sec latency 6574.821 ms 2024-01-19T04:55:37.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1300 0.25 MB/sec execute 459 sec latency 6605.848 ms 2024-01-19T04:55:38.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1303 0.25 MB/sec execute 460 sec latency 3105.701 ms 2024-01-19T04:55:39.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1304 0.25 MB/sec execute 461 sec latency 3912.779 ms 2024-01-19T04:55:40.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1307 0.25 MB/sec execute 462 sec latency 4107.216 ms 2024-01-19T04:55:41.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1312 0.25 MB/sec execute 463 sec latency 4681.862 ms 2024-01-19T04:55:42.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1320 0.25 MB/sec execute 464 sec latency 5681.927 ms 2024-01-19T04:55:43.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1321 0.25 MB/sec execute 465 sec latency 6682.001 ms 2024-01-19T04:55:44.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:55:44.341 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:55:44.892 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1321 0.25 MB/sec execute 466 sec latency 7416.798 ms 2024-01-19T04:55:45.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1322 0.25 MB/sec execute 467 sec latency 6789.743 ms 2024-01-19T04:55:46.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1322 0.25 MB/sec execute 468 sec latency 7789.790 ms 2024-01-19T04:55:47.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1323 0.25 MB/sec execute 469 sec latency 8369.905 ms 2024-01-19T04:55:48.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1323 0.25 MB/sec execute 470 sec latency 8062.892 ms 2024-01-19T04:55:49.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1324 0.25 MB/sec execute 471 sec latency 8431.156 ms 2024-01-19T04:55:50.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1326 0.25 MB/sec execute 472 sec latency 6801.143 ms 2024-01-19T04:55:51.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1326 0.25 MB/sec execute 473 sec latency 4079.261 ms 2024-01-19T04:55:52.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1326 0.25 MB/sec execute 474 sec latency 4796.922 ms 2024-01-19T04:55:53.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1327 0.25 MB/sec execute 475 sec latency 4203.107 ms 2024-01-19T04:55:54.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1331 0.25 MB/sec execute 476 sec latency 4840.395 ms 2024-01-19T04:55:55.893 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1339 0.25 MB/sec execute 477 sec latency 4887.282 ms 2024-01-19T04:55:56.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1347 0.26 MB/sec execute 478 sec latency 3144.758 ms 2024-01-19T04:55:57.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1348 0.26 MB/sec execute 479 sec latency 4144.806 ms 2024-01-19T04:55:58.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1349 0.26 MB/sec execute 480 sec latency 4690.413 ms 2024-01-19T04:55:59.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1350 0.26 MB/sec execute 481 sec latency 5045.894 ms 2024-01-19T04:56:00.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1352 0.25 MB/sec execute 482 sec latency 5171.924 ms 2024-01-19T04:56:01.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1353 0.25 MB/sec execute 483 sec latency 4226.664 ms 2024-01-19T04:56:02.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1353 0.25 MB/sec execute 484 sec latency 3464.922 ms 2024-01-19T04:56:03.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1354 0.25 MB/sec execute 485 sec latency 4464.992 ms 2024-01-19T04:56:04.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1355 0.25 MB/sec execute 486 sec latency 5008.487 ms 2024-01-19T04:56:05.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1360 0.25 MB/sec execute 487 sec latency 5047.978 ms 2024-01-19T04:56:06.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1368 0.26 MB/sec execute 488 sec latency 4905.070 ms 2024-01-19T04:56:07.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1388 0.27 MB/sec execute 489 sec latency 5506.612 ms 2024-01-19T04:56:08.894 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1394 0.27 MB/sec execute 490 sec latency 6506.687 ms 2024-01-19T04:56:09.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1396 0.27 MB/sec execute 491 sec latency 6963.008 ms 2024-01-19T04:56:10.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1396 0.27 MB/sec execute 492 sec latency 3706.783 ms 2024-01-19T04:56:11.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1398 0.27 MB/sec execute 493 sec latency 4706.884 ms 2024-01-19T04:56:12.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1398 0.27 MB/sec execute 494 sec latency 5706.941 ms 2024-01-19T04:56:13.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1399 0.27 MB/sec execute 495 sec latency 6359.977 ms 2024-01-19T04:56:14.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:56:14.418 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:56:14.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1400 0.27 MB/sec execute 496 sec latency 5039.059 ms 2024-01-19T04:56:15.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1401 0.27 MB/sec execute 497 sec latency 4563.161 ms 2024-01-19T04:56:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1402 0.27 MB/sec execute 498 sec latency 4432.148 ms 2024-01-19T04:56:17.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1402 0.27 MB/sec execute 499 sec latency 4347.294 ms 2024-01-19T04:56:18.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1404 0.27 MB/sec execute 500 sec latency 4732.890 ms 2024-01-19T04:56:19.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1406 0.27 MB/sec execute 501 sec latency 4866.025 ms 2024-01-19T04:56:20.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1407 0.27 MB/sec execute 502 sec latency 5086.362 ms 2024-01-19T04:56:21.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1409 0.27 MB/sec execute 503 sec latency 5039.684 ms 2024-01-19T04:56:22.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1411 0.27 MB/sec execute 504 sec latency 5126.233 ms 2024-01-19T04:56:23.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1412 0.27 MB/sec execute 505 sec latency 4067.534 ms 2024-01-19T04:56:24.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1413 0.27 MB/sec execute 506 sec latency 5067.605 ms 2024-01-19T04:56:25.227 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:26:12.854 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.299 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:26:12.926 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.357 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:26:12.984 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.416 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:26:13.027 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.417 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:13.028 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.422 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:13.033 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.426 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:26:13.037 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.485 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:13.095 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.498 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:26:13.110 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:56:25.895 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1413 0.27 MB/sec execute 507 sec latency 5322.357 ms 2024-01-19T04:56:26.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1415 0.26 MB/sec execute 508 sec latency 4591.769 ms 2024-01-19T04:56:27.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1416 0.26 MB/sec execute 509 sec latency 5108.070 ms 2024-01-19T04:56:28.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1418 0.26 MB/sec execute 510 sec latency 4507.749 ms 2024-01-19T04:56:29.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1419 0.26 MB/sec execute 511 sec latency 4588.155 ms 2024-01-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1421 0.26 MB/sec execute 512 sec latency 4742.536 ms 2024-01-19T04:56:31.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1423 0.26 MB/sec execute 513 sec latency 5293.716 ms 2024-01-19T04:56:32.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1425 0.26 MB/sec execute 514 sec latency 5864.230 ms 2024-01-19T04:56:33.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1428 0.26 MB/sec execute 515 sec latency 5100.974 ms 2024-01-19T04:56:34.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1429 0.26 MB/sec execute 516 sec latency 5265.549 ms 2024-01-19T04:56:35.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1430 0.26 MB/sec execute 517 sec latency 2483.408 ms 2024-01-19T04:56:36.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1430 0.26 MB/sec execute 518 sec latency 3483.480 ms 2024-01-19T04:56:37.896 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1431 0.26 MB/sec execute 519 sec latency 4232.190 ms 2024-01-19T04:56:38.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1432 0.26 MB/sec execute 520 sec latency 4282.062 ms 2024-01-19T04:56:39.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1433 0.26 MB/sec execute 521 sec latency 4654.984 ms 2024-01-19T04:56:40.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1434 0.26 MB/sec execute 522 sec latency 4346.863 ms 2024-01-19T04:56:41.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1435 0.26 MB/sec execute 523 sec latency 5185.298 ms 2024-01-19T04:56:42.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1437 0.26 MB/sec execute 524 sec latency 5265.387 ms 2024-01-19T04:56:43.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1439 0.26 MB/sec execute 525 sec latency 5219.849 ms 2024-01-19T04:56:44.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:56:44.635 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:56:44.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1442 0.26 MB/sec execute 526 sec latency 4791.871 ms 2024-01-19T04:56:45.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1445 0.26 MB/sec execute 527 sec latency 1912.255 ms 2024-01-19T04:56:46.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1448 0.25 MB/sec execute 528 sec latency 1959.425 ms 2024-01-19T04:56:47.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1451 0.25 MB/sec execute 529 sec latency 1371.866 ms 2024-01-19T04:56:48.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1453 0.25 MB/sec execute 530 sec latency 2289.741 ms 2024-01-19T04:56:49.897 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1453 0.25 MB/sec execute 531 sec latency 3289.822 ms 2024-01-19T04:56:50.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1454 0.25 MB/sec execute 532 sec latency 4289.889 ms 2024-01-19T04:56:51.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1455 0.25 MB/sec execute 533 sec latency 5067.726 ms 2024-01-19T04:56:52.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1456 0.25 MB/sec execute 534 sec latency 5132.030 ms 2024-01-19T04:56:53.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1456 0.25 MB/sec execute 535 sec latency 5995.071 ms 2024-01-19T04:56:54.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1458 0.25 MB/sec execute 536 sec latency 6667.263 ms 2024-01-19T04:56:55.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1460 0.25 MB/sec execute 537 sec latency 6500.199 ms 2024-01-19T04:56:56.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1461 0.25 MB/sec execute 538 sec latency 5380.151 ms 2024-01-19T04:56:57.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1463 0.25 MB/sec execute 539 sec latency 5246.119 ms 2024-01-19T04:56:58.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1466 0.25 MB/sec execute 540 sec latency 3273.859 ms 2024-01-19T04:56:59.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1467 0.25 MB/sec execute 541 sec latency 4273.927 ms 2024-01-19T04:57:00.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1468 0.25 MB/sec execute 542 sec latency 5274.024 ms 2024-01-19T04:57:01.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1468 0.25 MB/sec execute 543 sec latency 6274.125 ms 2024-01-19T04:57:02.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1472 0.25 MB/sec execute 544 sec latency 6329.781 ms 2024-01-19T04:57:03.898 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1474 0.25 MB/sec execute 545 sec latency 5589.683 ms 2024-01-19T04:57:04.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1475 0.25 MB/sec execute 546 sec latency 6589.773 ms 2024-01-19T04:57:05.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1475 0.25 MB/sec execute 547 sec latency 7589.839 ms 2024-01-19T04:57:06.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1476 0.25 MB/sec execute 548 sec latency 8016.140 ms 2024-01-19T04:57:07.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1477 0.25 MB/sec execute 549 sec latency 7212.697 ms 2024-01-19T04:57:08.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1479 0.24 MB/sec execute 550 sec latency 5397.810 ms 2024-01-19T04:57:09.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1480 0.24 MB/sec execute 551 sec latency 6397.874 ms 2024-01-19T04:57:10.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1480 0.24 MB/sec execute 552 sec latency 7397.937 ms 2024-01-19T04:57:11.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1481 0.24 MB/sec execute 553 sec latency 7753.583 ms 2024-01-19T04:57:12.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1481 0.24 MB/sec execute 554 sec latency 6315.846 ms 2024-01-19T04:57:13.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1483 0.24 MB/sec execute 555 sec latency 6590.398 ms 2024-01-19T04:57:14.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:57:14.741 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:57:14.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1486 0.24 MB/sec execute 556 sec latency 7449.269 ms 2024-01-19T04:57:15.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1491 0.24 MB/sec execute 557 sec latency 6858.611 ms 2024-01-19T04:57:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1493 0.24 MB/sec execute 558 sec latency 3761.029 ms 2024-01-19T04:57:17.899 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1494 0.24 MB/sec execute 559 sec latency 3773.799 ms 2024-01-19T04:57:18.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1496 0.24 MB/sec execute 560 sec latency 3116.753 ms 2024-01-19T04:57:19.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1497 0.24 MB/sec execute 561 sec latency 4116.838 ms 2024-01-19T04:57:20.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1498 0.24 MB/sec execute 562 sec latency 5058.314 ms 2024-01-19T04:57:21.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1499 0.24 MB/sec execute 563 sec latency 5881.761 ms 2024-01-19T04:57:22.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1501 0.24 MB/sec execute 564 sec latency 1604.080 ms 2024-01-19T04:57:23.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1502 0.24 MB/sec execute 565 sec latency 2232.295 ms 2024-01-19T04:57:24.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1504 0.24 MB/sec execute 566 sec latency 3232.389 ms 2024-01-19T04:57:25.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1506 0.24 MB/sec execute 567 sec latency 4232.483 ms 2024-01-19T04:57:26.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1508 0.24 MB/sec execute 568 sec latency 4467.934 ms 2024-01-19T04:57:27.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1509 0.24 MB/sec execute 569 sec latency 4331.176 ms 2024-01-19T04:57:28.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1511 0.24 MB/sec execute 570 sec latency 4730.233 ms 2024-01-19T04:57:29.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1513 0.24 MB/sec execute 571 sec latency 4856.755 ms 2024-01-19T04:57:30.900 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1515 0.24 MB/sec execute 572 sec latency 4408.541 ms 2024-01-19T04:57:31.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1517 0.24 MB/sec execute 573 sec latency 4308.073 ms 2024-01-19T04:57:32.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1519 0.24 MB/sec execute 574 sec latency 5308.128 ms 2024-01-19T04:57:33.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1519 0.23 MB/sec execute 575 sec latency 5969.297 ms 2024-01-19T04:57:34.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1520 0.23 MB/sec execute 576 sec latency 5847.235 ms 2024-01-19T04:57:35.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1521 0.23 MB/sec execute 577 sec latency 5530.825 ms 2024-01-19T04:57:36.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1521 0.23 MB/sec execute 578 sec latency 6053.860 ms 2024-01-19T04:57:37.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1525 0.23 MB/sec execute 579 sec latency 2885.077 ms 2024-01-19T04:57:38.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1525 0.23 MB/sec execute 580 sec latency 3885.157 ms 2024-01-19T04:57:39.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1527 0.23 MB/sec execute 581 sec latency 4885.259 ms 2024-01-19T04:57:40.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1529 0.23 MB/sec execute 582 sec latency 4908.807 ms 2024-01-19T04:57:41.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1532 0.23 MB/sec execute 583 sec latency 4826.019 ms 2024-01-19T04:57:42.837 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:27:30.464 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:42.866 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:27:30.478 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:42.868 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:27:30.495 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:42.878 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:30.489 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:42.880 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:27:30.491 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:42.899 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:30.509 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:42.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1533 0.23 MB/sec execute 584 sec latency 5826.107 ms 2024-01-19T04:57:43.009 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:27:30.620 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:43.077 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:27:30.704 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:43.139 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:30.749 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T04:57:43.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1535 0.23 MB/sec execute 585 sec latency 6308.716 ms 2024-01-19T04:57:44.875 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:57:44.878 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:57:44.901 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1537 0.23 MB/sec execute 586 sec latency 4977.806 ms 2024-01-19T04:57:45.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1538 0.23 MB/sec execute 587 sec latency 5195.741 ms 2024-01-19T04:57:46.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1540 0.23 MB/sec execute 588 sec latency 4713.426 ms 2024-01-19T04:57:47.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1541 0.23 MB/sec execute 589 sec latency 5149.229 ms 2024-01-19T04:57:48.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1543 0.23 MB/sec execute 590 sec latency 5203.777 ms 2024-01-19T04:57:49.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1544 0.23 MB/sec execute 591 sec latency 5763.504 ms 2024-01-19T04:57:50.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1545 0.23 MB/sec execute 592 sec latency 4797.994 ms 2024-01-19T04:57:51.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1547 0.23 MB/sec execute 593 sec latency 4587.277 ms 2024-01-19T04:57:52.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1548 0.23 MB/sec execute 594 sec latency 2670.860 ms 2024-01-19T04:57:53.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1549 0.23 MB/sec execute 595 sec latency 3670.961 ms 2024-01-19T04:57:54.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1551 0.23 MB/sec execute 596 sec latency 4671.022 ms 2024-01-19T04:57:55.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1553 0.23 MB/sec execute 597 sec latency 4868.307 ms 2024-01-19T04:57:56.902 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1555 0.23 MB/sec execute 598 sec latency 3963.129 ms 2024-01-19T04:57:57.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 1560 0.23 MB/sec execute 599 sec latency 4846.021 ms 2024-01-19T04:57:58.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 600 sec 2024-01-19T04:57:59.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 601 sec 2024-01-19T04:58:00.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 602 sec 2024-01-19T04:58:01.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 603 sec 2024-01-19T04:58:02.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 604 sec 2024-01-19T04:58:03.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 605 sec 2024-01-19T04:58:04.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 606 sec 2024-01-19T04:58:05.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 607 sec 2024-01-19T04:58:06.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 608 sec 2024-01-19T04:58:07.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 609 sec 2024-01-19T04:58:08.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 610 sec 2024-01-19T04:58:09.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 611 sec 2024-01-19T04:58:10.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 612 sec 2024-01-19T04:58:11.903 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 613 sec 2024-01-19T04:58:12.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 614 sec 2024-01-19T04:58:13.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 615 sec 2024-01-19T04:58:14.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 616 sec 2024-01-19T04:58:15.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:58:15.228 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:58:15.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 617 sec 2024-01-19T04:58:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 618 sec 2024-01-19T04:58:17.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 619 sec 2024-01-19T04:58:18.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 620 sec 2024-01-19T04:58:19.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 621 sec 2024-01-19T04:58:20.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 622 sec 2024-01-19T04:58:21.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 623 sec 2024-01-19T04:58:22.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 624 sec 2024-01-19T04:58:23.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 625 sec 2024-01-19T04:58:24.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 626 sec 2024-01-19T04:58:25.904 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 627 sec 2024-01-19T04:58:26.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 628 sec 2024-01-19T04:58:27.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 629 sec 2024-01-19T04:58:28.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 630 sec 2024-01-19T04:58:29.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 631 sec 2024-01-19T04:58:30.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 632 sec 2024-01-19T04:58:31.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 633 sec 2024-01-19T04:58:32.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 634 sec 2024-01-19T04:58:33.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 635 sec 2024-01-19T04:58:34.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 636 sec 2024-01-19T04:58:35.905 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 637 sec 2024-01-19T04:58:36.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 638 sec 2024-01-19T04:58:37.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 639 sec 2024-01-19T04:58:38.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 640 sec 2024-01-19T04:58:39.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 641 sec 2024-01-19T04:58:40.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 642 sec 2024-01-19T04:58:41.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 643 sec 2024-01-19T04:58:42.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 644 sec 2024-01-19T04:58:43.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 645 sec 2024-01-19T04:58:44.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 646 sec 2024-01-19T04:58:45.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:58:45.324 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:58:45.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 647 sec 2024-01-19T04:58:46.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 648 sec 2024-01-19T04:58:47.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 649 sec 2024-01-19T04:58:48.906 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 650 sec 2024-01-19T04:58:49.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 651 sec 2024-01-19T04:58:50.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 652 sec 2024-01-19T04:58:51.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 653 sec 2024-01-19T04:58:52.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 654 sec 2024-01-19T04:58:53.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 655 sec 2024-01-19T04:58:54.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 656 sec 2024-01-19T04:58:55.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 657 sec 2024-01-19T04:58:56.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 658 sec 2024-01-19T04:58:57.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 659 sec 2024-01-19T04:58:58.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 660 sec 2024-01-19T04:58:59.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 661 sec 2024-01-19T04:59:00.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 662 sec 2024-01-19T04:59:01.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 663 sec 2024-01-19T04:59:02.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 664 sec 2024-01-19T04:59:03.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 665 sec 2024-01-19T04:59:04.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 666 sec 2024-01-19T04:59:05.907 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 667 sec 2024-01-19T04:59:06.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 668 sec 2024-01-19T04:59:07.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 669 sec 2024-01-19T04:59:08.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 670 sec 2024-01-19T04:59:09.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 671 sec 2024-01-19T04:59:10.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 672 sec 2024-01-19T04:59:11.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 673 sec 2024-01-19T04:59:12.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 674 sec 2024-01-19T04:59:13.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 675 sec 2024-01-19T04:59:14.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 676 sec 2024-01-19T04:59:15.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:59:15.388 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:59:15.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 677 sec 2024-01-19T04:59:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 678 sec 2024-01-19T04:59:17.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 679 sec 2024-01-19T04:59:18.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 680 sec 2024-01-19T04:59:19.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 681 sec 2024-01-19T04:59:20.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 682 sec 2024-01-19T04:59:21.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 683 sec 2024-01-19T04:59:22.908 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 684 sec 2024-01-19T04:59:23.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 685 sec 2024-01-19T04:59:24.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 686 sec 2024-01-19T04:59:25.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 687 sec 2024-01-19T04:59:26.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 688 sec 2024-01-19T04:59:27.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 689 sec 2024-01-19T04:59:28.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 690 sec 2024-01-19T04:59:29.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 691 sec 2024-01-19T04:59:30.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 692 sec 2024-01-19T04:59:31.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 693 sec 2024-01-19T04:59:32.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 694 sec 2024-01-19T04:59:33.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 695 sec 2024-01-19T04:59:34.909 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 696 sec 2024-01-19T04:59:35.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 697 sec 2024-01-19T04:59:36.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 698 sec 2024-01-19T04:59:37.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 699 sec 2024-01-19T04:59:38.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 700 sec 2024-01-19T04:59:39.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 701 sec 2024-01-19T04:59:40.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 702 sec 2024-01-19T04:59:41.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 703 sec 2024-01-19T04:59:42.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 704 sec 2024-01-19T04:59:43.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 705 sec 2024-01-19T04:59:44.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 706 sec 2024-01-19T04:59:45.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:59:45.516 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:59:45.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 707 sec 2024-01-19T04:59:46.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 708 sec 2024-01-19T04:59:47.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 709 sec 2024-01-19T04:59:48.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 710 sec 2024-01-19T04:59:49.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 711 sec 2024-01-19T04:59:50.910 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 712 sec 2024-01-19T04:59:51.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 713 sec 2024-01-19T04:59:52.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 714 sec 2024-01-19T04:59:53.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 715 sec 2024-01-19T04:59:54.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 716 sec 2024-01-19T04:59:55.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 717 sec 2024-01-19T04:59:56.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 718 sec 2024-01-19T04:59:57.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 719 sec 2024-01-19T04:59:58.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 720 sec 2024-01-19T04:59:59.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 721 sec 2024-01-19T05:00:00.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 722 sec 2024-01-19T05:00:01.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 723 sec 2024-01-19T05:00:02.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 724 sec 2024-01-19T05:00:03.911 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 725 sec 2024-01-19T05:00:04.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 726 sec 2024-01-19T05:00:05.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 727 sec 2024-01-19T05:00:06.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 728 sec 2024-01-19T05:00:07.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 729 sec 2024-01-19T05:00:08.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 730 sec 2024-01-19T05:00:09.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 731 sec 2024-01-19T05:00:10.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 732 sec 2024-01-19T05:00:11.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 733 sec 2024-01-19T05:00:12.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 734 sec 2024-01-19T05:00:13.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 735 sec 2024-01-19T05:00:14.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 736 sec 2024-01-19T05:00:15.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:00:15.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:00:15.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 737 sec 2024-01-19T05:00:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 738 sec 2024-01-19T05:00:17.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 739 sec 2024-01-19T05:00:18.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 740 sec 2024-01-19T05:00:19.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 741 sec 2024-01-19T05:00:20.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 742 sec 2024-01-19T05:00:21.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 743 sec 2024-01-19T05:00:22.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 744 sec 2024-01-19T05:00:23.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 745 sec 2024-01-19T05:00:24.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 746 sec 2024-01-19T05:00:25.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 747 sec 2024-01-19T05:00:26.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 748 sec 2024-01-19T05:00:27.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 749 sec 2024-01-19T05:00:28.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 750 sec 2024-01-19T05:00:29.913 INFO:tasks.workunit.client.0.smithi133.stdout: 10 cleanup 751 sec 2024-01-19T05:00:30.913 INFO:tasks.workunit.client.0.smithi133.stdout: 9 cleanup 752 sec 2024-01-19T05:00:31.913 INFO:tasks.workunit.client.0.smithi133.stdout: 9 cleanup 753 sec 2024-01-19T05:00:32.914 INFO:tasks.workunit.client.0.smithi133.stdout: 8 cleanup 754 sec 2024-01-19T05:00:33.914 INFO:tasks.workunit.client.0.smithi133.stdout: 7 cleanup 755 sec 2024-01-19T05:00:34.914 INFO:tasks.workunit.client.0.smithi133.stdout: 5 cleanup 756 sec 2024-01-19T05:00:35.914 INFO:tasks.workunit.client.0.smithi133.stdout: 4 cleanup 757 sec 2024-01-19T05:00:36.914 INFO:tasks.workunit.client.0.smithi133.stdout: 2 cleanup 758 sec 2024-01-19T05:00:37.539 INFO:tasks.workunit.client.0.smithi133.stdout: 0 cleanup 759 sec 2024-01-19T05:00:37.539 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-01-19T05:00:37.539 INFO:tasks.workunit.client.0.smithi133.stdout: Operation Count AvgLat MaxLat 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: ---------------------------------------- 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: NTCreateX 1835 1031.135 6126.592 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Close 1562 8.222 107.709 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Rename 100 2023.342 4311.885 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Unlink 206 709.392 2279.041 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Qpathinfo 1285 509.154 3745.701 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Qfileinfo 610 30.786 240.657 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Qfsinfo 330 77.313 476.363 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Sfileinfo 340 152.057 452.842 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Find 547 5050.629 8840.870 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: WriteX 2646 44.017 568.494 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: ReadX 2419 0.325 34.156 2024-01-19T05:00:37.540 INFO:tasks.workunit.client.0.smithi133.stdout: Flush 250 622.234 2257.151 2024-01-19T05:00:37.541 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-01-19T05:00:37.541 INFO:tasks.workunit.client.0.smithi133.stdout:Throughput 0.22611 MB/sec 10 clients 10 procs max_latency=8840.880 ms 2024-01-19T05:00:37.541 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-19T05:00:37.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-19T05:00:45.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:00:45.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:01:09.788 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:30:57.414 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:09.797 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:30:57.424 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:09.823 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:57.433 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:09.823 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:30:57.435 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:09.839 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:57.450 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:09.846 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:30:57.458 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:09.955 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:30:57.582 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:10.011 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:30:57.622 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:10.027 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:57.637 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T05:01:15.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:01:15.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:01:31.531 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-01-19T05:01:31.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-19T05:01:31.837 DEBUG:teuthology.parallel:result is None 2024-01-19T05:01:31.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-19T05:01:32.506 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-19T05:01:32.506 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-19T05:01:32.518 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-19T05:01:32.518 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T05:01:32.518 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:01:32.524 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T05:01:32.525 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:01:32.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:01:32.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.746+0000 7f927e2fa640 1 Processor -- start 2024-01-19T05:01:32.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.746+0000 7f927e2fa640 1 -- start start 2024-01-19T05:01:32.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927e2fa640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92780cb320 0x7f927815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:32.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927e2fa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92780cb700 0x7f927806f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:32.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927e2fa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9278157540 con 0x7f92780c7be0 2024-01-19T05:01:32.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927e2fa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92781577e0 con 0x7f92780cb700 2024-01-19T05:01:32.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927e2fa640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9278157a80 con 0x7f92780cb320 2024-01-19T05:01:32.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f92777fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92780cb700 0x7f927806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:32.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927c897640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92780c7be0 0x7f92780c8070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51614/0 (socket says 172.21.15.133:51614) 2024-01-19T05:01:32.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.750+0000 7f927c897640 1 -- 172.21.15.133:0/1737713517 learned_addr learned my addr 172.21.15.133:0/1737713517 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:32.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.754+0000 7f92777fe640 1 -- 172.21.15.133:0/1737713517 >> v2:172.21.15.156:3300/0 conn(0x7f92780cb320 msgr2=0x7f927815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.754+0000 7f92777fe640 1 --2- 172.21.15.133:0/1737713517 >> v2:172.21.15.156:3300/0 conn(0x7f92780cb320 0x7f927815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.754+0000 7f92777fe640 1 -- 172.21.15.133:0/1737713517 >> v1:172.21.15.133:6789/0 conn(0x7f92780c7be0 legacy=0x7f92780c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.754+0000 7f92777fe640 1 -- 172.21.15.133:0/1737713517 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278157d40 con 0x7f92780cb700 2024-01-19T05:01:32.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.762+0000 7f92777fe640 1 --2- 172.21.15.133:0/1737713517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780cb700 0x7f927806f350 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f92780c2100 tx=0x7f926801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6e4132173cc580 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f9276ffd640 1 -- 172.21.15.133:0/1737713517 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680a8950 con 0x7f92780cb700 2024-01-19T05:01:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f9276ffd640 1 -- 172.21.15.133:0/1737713517 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680a8ab0 con 0x7f92780cb700 2024-01-19T05:01:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f9276ffd640 1 -- 172.21.15.133:0/1737713517 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680a8e40 con 0x7f92780cb700 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 -- 172.21.15.133:0/1737713517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780cb700 msgr2=0x7f927806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 --2- 172.21.15.133:0/1737713517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780cb700 0x7f927806f350 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f92780c2100 tx=0x7f926801ec50 comp rx=0 tx=0).stop 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 -- 172.21.15.133:0/1737713517 shutdown_connections 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 --2- 172.21.15.133:0/1737713517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780cb700 0x7f927806f350 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 --2- 172.21.15.133:0/1737713517 >> v2:172.21.15.156:3300/0 conn(0x7f92780cb320 0x7f927815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 -- 172.21.15.133:0/1737713517 >> 172.21.15.133:0/1737713517 conn(0x7f927806d590 msgr2=0x7f9278066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.766+0000 7f927e2fa640 1 -- 172.21.15.133:0/1737713517 shutdown_connections 2024-01-19T05:01:32.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 -- 172.21.15.133:0/1737713517 wait complete. 2024-01-19T05:01:32.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 Processor -- start 2024-01-19T05:01:32.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 -- start start 2024-01-19T05:01:32.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 0x7f9278156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:32.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92780cb320 0x7f92780c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:32.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92780cb700 0x7f92780c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:32.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780c3330 con 0x7f92780c7be0 2024-01-19T05:01:32.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780ca490 con 0x7f92780cb700 2024-01-19T05:01:32.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f927e2fa640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9278147b90 con 0x7f92780cb320 2024-01-19T05:01:32.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f9277fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 0x7f9278156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:32.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f9277fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 0x7f9278156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45980/0 (socket says 172.21.15.133:45980) 2024-01-19T05:01:32.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.770+0000 7f9277fff640 1 -- 172.21.15.133:0/2972629989 learned_addr learned my addr 172.21.15.133:0/2972629989 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:32.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.774+0000 7f92777fe640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92780cb320 0x7f92780c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:32.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.774+0000 7f9277fff640 1 -- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92780cb320 msgr2=0x7f92780c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:32.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.774+0000 7f9277fff640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92780cb320 0x7f92780c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:32.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.774+0000 7f9277fff640 1 -- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92780cb700 msgr2=0x7f92780c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:32.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.774+0000 7f9277fff640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92780cb700 0x7f92780c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:32.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.774+0000 7f9277fff640 1 -- 172.21.15.133:0/2972629989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268009420 con 0x7f92780c7be0 2024-01-19T05:01:32.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.778+0000 7f9277fff640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 0x7f9278156150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f926c00b550 tx=0x7f926c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:32.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.782+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c010870 con 0x7f92780c7be0 2024-01-19T05:01:32.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.782+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c0109f0 con 0x7f92780c7be0 2024-01-19T05:01:32.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.782+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c010da0 con 0x7f92780c7be0 2024-01-19T05:01:32.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.782+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9278156850 con 0x7f92780c7be0 2024-01-19T05:01:32.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.782+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92780c3a60 con 0x7f92780c7be0 2024-01-19T05:01:32.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.782+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9278074340 con 0x7f92780c7be0 2024-01-19T05:01:32.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.802+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f926c023480 con 0x7f92780c7be0 2024-01-19T05:01:32.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.802+0000 7f9274ff9640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9264066550 0x7f9264068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:32.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.802+0000 7f92777fe640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9264066550 0x7f9264068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:32.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.802+0000 7f92777fe640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9264066550 0x7f9264068a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92680b2000 tx=0x7f92680aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:32.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:32.806+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f926c055990 con 0x7f92780c7be0 2024-01-19T05:01:33.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.078+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f926c0515d0 con 0x7f92780c7be0 2024-01-19T05:01:33.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.258+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f927806e720 con 0x7f92780c7be0 2024-01-19T05:01:33.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.338+0000 7f9274ff9640 1 -- 172.21.15.133:0/2972629989 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18782 (secure 0 0 0) 0x7f926c01e090 con 0x7f92780c7be0 2024-01-19T05:01:33.338 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:01:33.338 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":31,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:32:36.898530+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:01:33.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9264066550 msgr2=0x7f9264068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9264066550 0x7f9264068a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92680b2000 tx=0x7f92680aa070 comp rx=0 tx=0).stop 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 msgr2=0x7f9278156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 0x7f9278156150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f926c00b550 tx=0x7f926c00ba10 comp rx=0 tx=0).stop 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 shutdown_connections 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9264066550 0x7f9264068a10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92780cb700 0x7f92780c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92780cb320 0x7f92780c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 --2- 172.21.15.133:0/2972629989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92780c7be0 0x7f9278156150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 >> 172.21.15.133:0/2972629989 conn(0x7f927806d590 msgr2=0x7f927806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 shutdown_connections 2024-01-19T05:01:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.342+0000 7f927e2fa640 1 -- 172.21.15.133:0/2972629989 wait complete. 2024-01-19T05:01:33.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:31:30.230778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:31:31.446896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-19T04:31:37.539878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-19T05:01:33.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:01:33.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.490+0000 7f06f39c6640 1 Processor -- start 2024-01-19T05:01:33.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.490+0000 7f06f39c6640 1 -- start start 2024-01-19T05:01:33.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f39c6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 0x7f06ec06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f39c6640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06ec06dfd0 0x7f06ec151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f39c6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec15a9d0 con 0x7f06ec0c8310 2024-01-19T05:01:33.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f39c6640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec1573e0 con 0x7f06ec06dfd0 2024-01-19T05:01:33.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f39c6640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1576a0 con 0x7f06ec0c7f30 2024-01-19T05:01:33.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f1f63640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f06ec0c8310 0x7f06ec15ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51624/0 (socket says 172.21.15.133:51624) 2024-01-19T05:01:33.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f1f63640 1 -- 172.21.15.133:0/3642900008 learned_addr learned my addr 172.21.15.133:0/3642900008 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:33.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f0f61640 1 --2- 172.21.15.133:0/3642900008 >> v2:172.21.15.156:3300/0 conn(0x7f06ec06dfd0 0x7f06ec151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.494+0000 7f06f1762640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 0x7f06ec06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.498+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251071230 0 0) 0x7f06ec15a9d0 con 0x7f06ec0c8310 2024-01-19T05:01:33.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.498+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d8003530 con 0x7f06ec0c8310 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1846900533 0 0) 0x7f06d8003530 con 0x7f06ec0c8310 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 msgr2=0x7f06ec06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 0x7f06ec06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 >> v2:172.21.15.156:3300/0 conn(0x7f06ec06dfd0 msgr2=0x7f06ec151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 --2- 172.21.15.133:0/3642900008 >> v2:172.21.15.156:3300/0 conn(0x7f06ec06dfd0 0x7f06ec151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec157980 con 0x7f06ec0c8310 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f06e4001a00 con 0x7f06ec0c8310 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 >> v1:172.21.15.133:6789/0 conn(0x7f06ec0c8310 legacy=0x7f06ec15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 0x7f06d80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d8003fc0 0x7f06d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06d8004d10 0x7f06d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1573e0 con 0x7f06d8003fc0 2024-01-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1576a0 con 0x7f06d8004d10 2024-01-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d800baa0 con 0x7f06ec0c7f30 2024-01-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.502+0000 7f06f0f61640 1 --2- 172.21.15.133:0/3642900008 >> v2:172.21.15.156:3300/0 conn(0x7f06ec06dfd0 0x7f06ec151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f0f61640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d8003fc0 0x7f06d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f1762640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 0x7f06d80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f0f61640 1 -- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 msgr2=0x7f06d80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:33.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f0f61640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06ec0c7f30 0x7f06d80039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f0f61640 1 -- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06d8004d10 msgr2=0x7f06d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:33.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f0f61640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06d8004d10 0x7f06d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.506+0000 7f06f0f61640 1 -- 172.21.15.133:0/3642900008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8003530 con 0x7f06d8003fc0 2024-01-19T05:01:33.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.510+0000 7f06f0f61640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d8003fc0 0x7f06d80047d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009c90 tx=0x7f06dc01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af933dcb1932025 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004020 con 0x7f06d8003fc0 2024-01-19T05:01:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc004180 con 0x7f06d8003fc0 2024-01-19T05:01:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06e3fff640 1 -- 172.21.15.133:0/3642900008 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0a5910 con 0x7f06d8003fc0 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- 172.21.15.133:0/3642900008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d8003fc0 msgr2=0x7f06d80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 --2- 172.21.15.133:0/3642900008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d8003fc0 0x7f06d80047d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009c90 tx=0x7f06dc01cc50 comp rx=0 tx=0).stop 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f1f63640 1 -- 172.21.15.133:0/3642900008 reap_dead start 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- 172.21.15.133:0/3642900008 shutdown_connections 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- 172.21.15.133:0/3642900008 >> 172.21.15.133:0/3642900008 conn(0x7f06ec06aa60 msgr2=0x7f06ec06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- 172.21.15.133:0/3642900008 shutdown_connections 2024-01-19T05:01:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- 172.21.15.133:0/3642900008 wait complete. 2024-01-19T05:01:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 Processor -- start 2024-01-19T05:01:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- start start 2024-01-19T05:01:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06d8003fc0 0x7f06ec1f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 0x7f06ec145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06ec1ed890 0x7f06ec143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1ed0d0 con 0x7f06ec151ea0 2024-01-19T05:01:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0c2d10 con 0x7f06ec1ed890 2024-01-19T05:01:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f39c6640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0c2ff0 con 0x7f06d8003fc0 2024-01-19T05:01:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.518+0000 7f06f0f61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 0x7f06ec145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.522+0000 7f06f0f61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 0x7f06ec145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46000/0 (socket says 172.21.15.133:46000) 2024-01-19T05:01:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.522+0000 7f06f0f61640 1 -- 172.21.15.133:0/2532836632 learned_addr learned my addr 172.21.15.133:0/2532836632 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:33.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.522+0000 7f06f1762640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06d8003fc0 0x7f06ec1f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.522+0000 7f06f1f63640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06ec1ed890 0x7f06ec143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.526+0000 7f06f0f61640 1 -- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06d8003fc0 msgr2=0x7f06ec1f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.526+0000 7f06f0f61640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06d8003fc0 0x7f06ec1f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.526+0000 7f06f0f61640 1 -- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06ec1ed890 msgr2=0x7f06ec143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.526+0000 7f06f0f61640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06ec1ed890 0x7f06ec143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.526+0000 7f06f0f61640 1 -- 172.21.15.133:0/2532836632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0c32d0 con 0x7f06ec151ea0 2024-01-19T05:01:33.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.526+0000 7f06f0f61640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 0x7f06ec145a80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06dc01ca80 tx=0x7f06d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:33.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.530+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0a5b10 con 0x7f06ec151ea0 2024-01-19T05:01:33.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.530+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0a5c70 con 0x7f06ec151ea0 2024-01-19T05:01:33.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.530+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc006040 con 0x7f06ec151ea0 2024-01-19T05:01:33.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.530+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec1ed370 con 0x7f06ec151ea0 2024-01-19T05:01:33.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.530+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec0c35b0 con 0x7f06ec151ea0 2024-01-19T05:01:33.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.530+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec1f1480 con 0x7f06ec151ea0 2024-01-19T05:01:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.814+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f06dc0061a0 con 0x7f06ec151ea0 2024-01-19T05:01:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.814+0000 7f06e1ffb640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f06d0066580 0x7f06d0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:33.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.814+0000 7f06f1762640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f06d0066580 0x7f06d0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.818+0000 7f06f1762640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f06d0066580 0x7f06d0068a40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009a00 tx=0x7f06e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.834+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06dc0eff20 con 0x7f06ec151ea0 2024-01-19T05:01:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:33.834+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f06dc0ec260 con 0x7f06ec151ea0 2024-01-19T05:01:34.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.010+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06ec1f1480 con 0x7f06ec151ea0 2024-01-19T05:01:34.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.022+0000 7f06e1ffb640 1 -- 172.21.15.133:0/2532836632 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06ec1f1480 con 0x7f06ec151ea0 2024-01-19T05:01:34.021 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f06d0066580 msgr2=0x7f06d0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f06d0066580 0x7f06d0068a40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009a00 tx=0x7f06e8008040 comp rx=0 tx=0).stop 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 msgr2=0x7f06ec145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 0x7f06ec145a80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06dc01ca80 tx=0x7f06d8005800 comp rx=0 tx=0).stop 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 shutdown_connections 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f06d0066580 0x7f06d0068a40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06ec1ed890 0x7f06ec143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ec151ea0 0x7f06ec145a80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 --2- 172.21.15.133:0/2532836632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06d8003fc0 0x7f06ec1f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 >> 172.21.15.133:0/2532836632 conn(0x7f06ec06aa60 msgr2=0x7f06ec071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 shutdown_connections 2024-01-19T05:01:34.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.026+0000 7f06f39c6640 1 -- 172.21.15.133:0/2532836632 wait complete. 2024-01-19T05:01:34.042 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:01:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 Processor -- start 2024-01-19T05:01:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 -- start start 2024-01-19T05:01:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f080c57d0 0x7f9f08156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9f080c7cd0 0x7f9f080c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f08156760 con 0x7f9f081503c0 2024-01-19T05:01:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f080c5c10 con 0x7f9f080c7cd0 2024-01-19T05:01:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f0d48e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081507a0 con 0x7f9f080c57d0 2024-01-19T05:01:34.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f067fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f080c57d0 0x7f9f08156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f06ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f081503c0 0x7f9f08072760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51628/0 (socket says 172.21.15.133:51628) 2024-01-19T05:01:34.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.174+0000 7f9f06ffd640 1 -- 172.21.15.133:0/525007361 learned_addr learned my addr 172.21.15.133:0/525007361 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.178+0000 7f9f077fe640 1 --2- 172.21.15.133:0/525007361 >> v2:172.21.15.156:3300/0 conn(0x7f9f080c7cd0 0x7f9f080c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.182+0000 7f9f067fc640 1 -- 172.21.15.133:0/525007361 >> v2:172.21.15.156:3300/0 conn(0x7f9f080c7cd0 msgr2=0x7f9f080c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.182+0000 7f9f067fc640 1 --2- 172.21.15.133:0/525007361 >> v2:172.21.15.156:3300/0 conn(0x7f9f080c7cd0 0x7f9f080c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.182+0000 7f9f067fc640 1 -- 172.21.15.133:0/525007361 >> v1:172.21.15.133:6789/0 conn(0x7f9f081503c0 legacy=0x7f9f08072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.182+0000 7f9f067fc640 1 -- 172.21.15.133:0/525007361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08071a10 con 0x7f9f080c57d0 2024-01-19T05:01:34.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.186+0000 7f9f067fc640 1 --2- 172.21.15.133:0/525007361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f080c57d0 0x7f9f08156bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0097c0 tx=0x7f9efc01ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98e8dfb45dcc7011 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:34.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.210+0000 7f9f05ffb640 1 -- 172.21.15.133:0/525007361 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0a88f0 con 0x7f9f080c57d0 2024-01-19T05:01:34.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f05ffb640 1 -- 172.21.15.133:0/525007361 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0a8a50 con 0x7f9f080c57d0 2024-01-19T05:01:34.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f05ffb640 1 -- 172.21.15.133:0/525007361 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0a8de0 con 0x7f9f080c57d0 2024-01-19T05:01:34.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 -- 172.21.15.133:0/525007361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f080c57d0 msgr2=0x7f9f08156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/525007361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f080c57d0 0x7f9f08156bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0097c0 tx=0x7f9efc01ec30 comp rx=0 tx=0).stop 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 -- 172.21.15.133:0/525007361 shutdown_connections 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/525007361 >> v2:172.21.15.156:3300/0 conn(0x7f9f080c7cd0 0x7f9f080c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/525007361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f080c57d0 0x7f9f08156bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 -- 172.21.15.133:0/525007361 >> 172.21.15.133:0/525007361 conn(0x7f9f0806aa60 msgr2=0x7f9f0806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 -- 172.21.15.133:0/525007361 shutdown_connections 2024-01-19T05:01:34.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.310+0000 7f9f0d48e640 1 -- 172.21.15.133:0/525007361 wait complete. 2024-01-19T05:01:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 Processor -- start 2024-01-19T05:01:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 -- start start 2024-01-19T05:01:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f080c57d0 0x7f9f081f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f080c7cd0 0x7f9f0806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f081503c0 0x7f9f081e9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081e8ee0 con 0x7f9f080c57d0 2024-01-19T05:01:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081e8b90 con 0x7f9f080c7cd0 2024-01-19T05:01:34.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.314+0000 7f9f0d48e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081f3890 con 0x7f9f081503c0 2024-01-19T05:01:34.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.318+0000 7f9f077fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f081503c0 0x7f9f081e9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.318+0000 7f9f067fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f080c7cd0 0x7f9f0806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.318+0000 7f9f077fe640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f081503c0 0x7f9f081e9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:40898/0 (socket says 172.21.15.133:40898) 2024-01-19T05:01:34.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.318+0000 7f9f077fe640 1 -- 172.21.15.133:0/1255622125 learned_addr learned my addr 172.21.15.133:0/1255622125 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:34.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.322+0000 7f9f06ffd640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f080c57d0 0x7f9f081f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.326+0000 7f9f06ffd640 1 -- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f081503c0 msgr2=0x7f9f081e9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.326+0000 7f9f06ffd640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f081503c0 0x7f9f081e9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.326+0000 7f9f06ffd640 1 -- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f080c7cd0 msgr2=0x7f9f0806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.326+0000 7f9f06ffd640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f080c7cd0 0x7f9f0806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.326+0000 7f9f06ffd640 1 -- 172.21.15.133:0/1255622125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009420 con 0x7f9f080c57d0 2024-01-19T05:01:34.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.330+0000 7f9f06ffd640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f080c57d0 0x7f9f081f3350 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800b490 tx=0x7f9ef800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:34.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.334+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8011830 con 0x7f9f080c57d0 2024-01-19T05:01:34.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.334+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef80119b0 con 0x7f9f080c57d0 2024-01-19T05:01:34.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.334+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8011d60 con 0x7f9f080c57d0 2024-01-19T05:01:34.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.334+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f081ef9a0 con 0x7f9f080c57d0 2024-01-19T05:01:34.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.334+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f081eff60 con 0x7f9f080c57d0 2024-01-19T05:01:34.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.338+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f08074340 con 0x7f9f080c57d0 2024-01-19T05:01:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.358+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9ef80047f0 con 0x7f9f080c57d0 2024-01-19T05:01:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.358+0000 7f9eef7fe640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9ef4066580 0x7f9ef4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.358+0000 7f9f067fc640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9ef4066580 0x7f9ef4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.358+0000 7f9f067fc640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9ef4066580 0x7f9ef4068a40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0b2000 tx=0x7f9efc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:34.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.618+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ef80550a0 con 0x7f9f080c57d0 2024-01-19T05:01:34.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.618+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9ef80513e0 con 0x7f9f080c57d0 2024-01-19T05:01:34.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.794+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f080c6320 con 0x7f9f080c57d0 2024-01-19T05:01:34.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.802+0000 7f9eef7fe640 1 -- 172.21.15.133:0/1255622125 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ef8054a00 con 0x7f9f080c57d0 2024-01-19T05:01:34.803 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T05:01:34.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9ef4066580 msgr2=0x7f9ef4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9ef4066580 0x7f9ef4068a40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0b2000 tx=0x7f9efc008040 comp rx=0 tx=0).stop 2024-01-19T05:01:34.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f080c57d0 msgr2=0x7f9f081f3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f080c57d0 0x7f9f081f3350 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800b490 tx=0x7f9ef800b950 comp rx=0 tx=0).stop 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 shutdown_connections 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f9ef4066580 0x7f9ef4068a40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f080c7cd0 0x7f9f0806d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f081503c0 0x7f9f081e9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 --2- 172.21.15.133:0/1255622125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f080c57d0 0x7f9f081f3350 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 >> 172.21.15.133:0/1255622125 conn(0x7f9f0806aa60 msgr2=0x7f9f0806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 shutdown_connections 2024-01-19T05:01:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.810+0000 7f9f0d48e640 1 -- 172.21.15.133:0/1255622125 wait complete. 2024-01-19T05:01:34.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:01:34.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 Processor -- start 2024-01-19T05:01:34.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 -- start start 2024-01-19T05:01:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb70151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb70071970 0x7feb701516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7015a9d0 con 0x7feb700c7f30 2024-01-19T05:01:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb701573e0 con 0x7feb70071970 2024-01-19T05:01:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb78309640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7006e1a0 con 0x7feb700c8310 2024-01-19T05:01:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb768a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb70071970 0x7feb701516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb768a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb70071970 0x7feb701516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46024/0 (socket says 172.21.15.133:46024) 2024-01-19T05:01:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb768a6640 1 -- 172.21.15.133:0/849634674 learned_addr learned my addr 172.21.15.133:0/849634674 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.954+0000 7feb758a4640 1 --2- 172.21.15.133:0/849634674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb70151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.958+0000 7feb768a6640 1 -- 172.21.15.133:0/849634674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 msgr2=0x7feb70151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.958+0000 7feb768a6640 1 --2- 172.21.15.133:0/849634674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb70151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.958+0000 7feb768a6640 1 -- 172.21.15.133:0/849634674 >> v1:172.21.15.156:6789/0 conn(0x7feb700c7f30 legacy=0x7feb7006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.958+0000 7feb768a6640 1 -- 172.21.15.133:0/849634674 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb701576a0 con 0x7feb70071970 2024-01-19T05:01:34.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.962+0000 7feb768a6640 1 --2- 172.21.15.133:0/849634674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb70071970 0x7feb701516d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb68009e50 tx=0x7feb6801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d9432abe2e2c8f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.962+0000 7feb750a3640 1 -- 172.21.15.133:0/849634674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680af400 con 0x7feb70071970 2024-01-19T05:01:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb750a3640 1 -- 172.21.15.133:0/849634674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb680ab050 con 0x7feb70071970 2024-01-19T05:01:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb750a3640 1 -- 172.21.15.133:0/849634674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680af780 con 0x7feb70071970 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- 172.21.15.133:0/849634674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb70071970 msgr2=0x7feb701516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 --2- 172.21.15.133:0/849634674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb70071970 0x7feb701516d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb68009e50 tx=0x7feb6801f1f0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- 172.21.15.133:0/849634674 shutdown_connections 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 --2- 172.21.15.133:0/849634674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb70071970 0x7feb701516d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 --2- 172.21.15.133:0/849634674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb70151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- 172.21.15.133:0/849634674 >> 172.21.15.133:0/849634674 conn(0x7feb7006aa60 msgr2=0x7feb7006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- 172.21.15.133:0/849634674 shutdown_connections 2024-01-19T05:01:34.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- 172.21.15.133:0/849634674 wait complete. 2024-01-19T05:01:34.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 Processor -- start 2024-01-19T05:01:34.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- start start 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb70071970 0x7feb700c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 0x7feb7014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb700c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c4320 con 0x7feb700c7f30 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c1760 con 0x7feb70071970 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.966+0000 7feb78309640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c1a40 con 0x7feb700c8310 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.970+0000 7feb758a4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 0x7feb7014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.970+0000 7feb758a4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 0x7feb7014ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46034/0 (socket says 172.21.15.133:46034) 2024-01-19T05:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.970+0000 7feb758a4640 1 -- 172.21.15.133:0/2709613678 learned_addr learned my addr 172.21.15.133:0/2709613678 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:34.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.970+0000 7feb768a6640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb700c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.970+0000 7feb760a5640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb70071970 0x7feb700c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.974+0000 7feb758a4640 1 -- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 msgr2=0x7feb700c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.974+0000 7feb758a4640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb700c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.974+0000 7feb758a4640 1 -- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb70071970 msgr2=0x7feb700c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.974+0000 7feb758a4640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb70071970 0x7feb700c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.974+0000 7feb758a4640 1 -- 172.21.15.133:0/2709613678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68009b30 con 0x7feb700c7f30 2024-01-19T05:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.974+0000 7feb758a4640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 0x7feb7014ebd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feb6000d7d0 tx=0x7feb6000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:34.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.978+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000b6c0 con 0x7feb700c7f30 2024-01-19T05:01:34.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.978+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000b820 con 0x7feb700c7f30 2024-01-19T05:01:34.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.978+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bbb0 con 0x7feb700c7f30 2024-01-19T05:01:34.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.978+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb700c1d20 con 0x7feb700c7f30 2024-01-19T05:01:34.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.978+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7014f260 con 0x7feb700c7f30 2024-01-19T05:01:34.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.978+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70074340 con 0x7feb700c7f30 2024-01-19T05:01:34.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.998+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7feb6000bd10 con 0x7feb700c7f30 2024-01-19T05:01:34.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.998+0000 7feb66ffd640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7feb54066580 0x7feb54068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:34.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:34.998+0000 7feb760a5640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7feb54066580 0x7feb54068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:34.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.002+0000 7feb760a5640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7feb54066580 0x7feb54068a40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb6c007fd0 tx=0x7feb6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.286+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb60055cd0 con 0x7feb700c7f30 2024-01-19T05:01:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.286+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7feb60052010 con 0x7feb700c7f30 2024-01-19T05:01:35.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.462+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb700c74c0 con 0x7feb700c7f30 2024-01-19T05:01:35.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.486+0000 7feb66ffd640 1 -- 172.21.15.133:0/2709613678 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb60055630 con 0x7feb700c7f30 2024-01-19T05:01:35.486 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7feb54066580 msgr2=0x7feb54068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7feb54066580 0x7feb54068a40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb6c007fd0 tx=0x7feb6c009040 comp rx=0 tx=0).stop 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 msgr2=0x7feb7014ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 0x7feb7014ebd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feb6000d7d0 tx=0x7feb6000dc90 comp rx=0 tx=0).stop 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 shutdown_connections 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7feb54066580 0x7feb54068a40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb700c8310 0x7feb700c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700c7f30 0x7feb7014ebd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 --2- 172.21.15.133:0/2709613678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb70071970 0x7feb700c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 >> 172.21.15.133:0/2709613678 conn(0x7feb7006aa60 msgr2=0x7feb700c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 shutdown_connections 2024-01-19T05:01:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.490+0000 7feb78309640 1 -- 172.21.15.133:0/2709613678 wait complete. 2024-01-19T05:01:35.507 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-19T05:01:35.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 Processor -- start 2024-01-19T05:01:35.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 -- start start 2024-01-19T05:01:35.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc33006b8b0 0x7fc33015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3300c5280 0x7fc33015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300c8ea0 con 0x7fc3300c4ea0 2024-01-19T05:01:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33006bd40 con 0x7fc3300c5280 2024-01-19T05:01:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc3386ee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300c88e0 con 0x7fc33006b8b0 2024-01-19T05:01:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc336c8b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3300c5280 0x7fc33015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc336c8b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3300c5280 0x7fc33015b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46042/0 (socket says 172.21.15.133:46042) 2024-01-19T05:01:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.634+0000 7fc336c8b640 1 -- 172.21.15.133:0/1087183621 learned_addr learned my addr 172.21.15.133:0/1087183621 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:35.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.638+0000 7fc336c8b640 1 -- 172.21.15.133:0/1087183621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc33006b8b0 msgr2=0x7fc33015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:35.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.638+0000 7fc336c8b640 1 --2- 172.21.15.133:0/1087183621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc33006b8b0 0x7fc33015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.638+0000 7fc336c8b640 1 -- 172.21.15.133:0/1087183621 >> v1:172.21.15.156:6789/0 conn(0x7fc3300c4ea0 legacy=0x7fc33006a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:35.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.638+0000 7fc336c8b640 1 -- 172.21.15.133:0/1087183621 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300c8bc0 con 0x7fc3300c5280 2024-01-19T05:01:35.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.642+0000 7fc336c8b640 1 --2- 172.21.15.133:0/1087183621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300c5280 0x7fc33015b720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc328009e50 tx=0x7fc32801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdc0cc5322689e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:35.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc335488640 1 -- 172.21.15.133:0/1087183621 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280a5840 con 0x7fc3300c5280 2024-01-19T05:01:35.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc335488640 1 -- 172.21.15.133:0/1087183621 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3280a59a0 con 0x7fc3300c5280 2024-01-19T05:01:35.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc335488640 1 -- 172.21.15.133:0/1087183621 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280a5d30 con 0x7fc3300c5280 2024-01-19T05:01:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 -- 172.21.15.133:0/1087183621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300c5280 msgr2=0x7fc33015b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1087183621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300c5280 0x7fc33015b720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc328009e50 tx=0x7fc32801c9a0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 -- 172.21.15.133:0/1087183621 shutdown_connections 2024-01-19T05:01:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1087183621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300c5280 0x7fc33015b720 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1087183621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc33006b8b0 0x7fc33015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 -- 172.21.15.133:0/1087183621 >> 172.21.15.133:0/1087183621 conn(0x7fc33006fa20 msgr2=0x7fc3300c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:35.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 -- 172.21.15.133:0/1087183621 shutdown_connections 2024-01-19T05:01:35.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.646+0000 7fc3386ee640 1 -- 172.21.15.133:0/1087183621 wait complete. 2024-01-19T05:01:35.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 Processor -- start 2024-01-19T05:01:35.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 -- start start 2024-01-19T05:01:35.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3300c4ea0 0x7fc3300c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3300c5280 0x7fc33013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 0x7fc330146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300c99c0 con 0x7fc3301467d0 2024-01-19T05:01:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301f3200 con 0x7fc3300c4ea0 2024-01-19T05:01:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc3386ee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301f34e0 con 0x7fc3300c5280 2024-01-19T05:01:35.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc336c8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 0x7fc330146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:35.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc336c8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 0x7fc330146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46056/0 (socket says 172.21.15.133:46056) 2024-01-19T05:01:35.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc336c8b640 1 -- 172.21.15.133:0/1545452174 learned_addr learned my addr 172.21.15.133:0/1545452174 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:35.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.650+0000 7fc335c89640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3300c5280 0x7fc33013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:35.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.654+0000 7fc336c8b640 1 -- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3300c5280 msgr2=0x7fc33013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:35.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.654+0000 7fc336c8b640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3300c5280 0x7fc33013f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.654+0000 7fc336c8b640 1 -- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3300c4ea0 msgr2=0x7fc3300c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:35.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.654+0000 7fc336c8b640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3300c4ea0 0x7fc3300c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:35.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.654+0000 7fc336c8b640 1 -- 172.21.15.133:0/1545452174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009b30 con 0x7fc3301467d0 2024-01-19T05:01:35.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.658+0000 7fc336c8b640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 0x7fc330146c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc3280af040 tx=0x7fc328019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.662+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280b8880 con 0x7fc3301467d0 2024-01-19T05:01:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.662+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3280b8a00 con 0x7fc3301467d0 2024-01-19T05:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.662+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280b8db0 con 0x7fc3301467d0 2024-01-19T05:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.662+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3301f37c0 con 0x7fc3301467d0 2024-01-19T05:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.662+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3301f3d80 con 0x7fc3301467d0 2024-01-19T05:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.662+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3301f3f70 con 0x7fc3301467d0 2024-01-19T05:01:35.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.686+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc3280c2410 con 0x7fc3301467d0 2024-01-19T05:01:35.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.686+0000 7fc326ffd640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc314066530 0x7fc3140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.686+0000 7fc33648a640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc314066530 0x7fc3140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.690+0000 7fc33648a640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc314066530 0x7fc3140689f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc32c007fd0 tx=0x7fc32c0079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:35.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.690+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3280f1750 con 0x7fc3301467d0 2024-01-19T05:01:35.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:35.962+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc3280ed390 con 0x7fc3301467d0 2024-01-19T05:01:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.134+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3301f3f70 con 0x7fc3301467d0 2024-01-19T05:01:36.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.170+0000 7fc326ffd640 1 -- 172.21.15.133:0/1545452174 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3280f09b0 con 0x7fc3301467d0 2024-01-19T05:01:36.168 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc314066530 msgr2=0x7fc3140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc314066530 0x7fc3140689f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc32c007fd0 tx=0x7fc32c0079a0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 msgr2=0x7fc330146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 0x7fc330146c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc3280af040 tx=0x7fc328019740 comp rx=0 tx=0).stop 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 shutdown_connections 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fc314066530 0x7fc3140689f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3301467d0 0x7fc330146c60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3300c5280 0x7fc33013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 --2- 172.21.15.133:0/1545452174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3300c4ea0 0x7fc3300c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 >> 172.21.15.133:0/1545452174 conn(0x7fc33006fa20 msgr2=0x7fc330150540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 shutdown_connections 2024-01-19T05:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.174+0000 7fc3386ee640 1 -- 172.21.15.133:0/1545452174 wait complete. 2024-01-19T05:01:36.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T05:01:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.318+0000 7ff81d4ff640 1 Processor -- start 2024-01-19T05:01:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.318+0000 7ff81d4ff640 1 -- start start 2024-01-19T05:01:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff81d4ff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff8180c8310 0x7ff818151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff81d4ff640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81815a9d0 con 0x7ff8180c7f30 2024-01-19T05:01:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff81d4ff640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8181573e0 con 0x7ff818071970 2024-01-19T05:01:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff81d4ff640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81806e1a0 con 0x7ff8180c8310 2024-01-19T05:01:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff816ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8180c7f30 0x7ff81806da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51634/0 (socket says 172.21.15.133:51634) 2024-01-19T05:01:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff816ffd640 1 -- 172.21.15.133:0/1792302334 learned_addr learned my addr 172.21.15.133:0/1792302334 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:36.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.322+0000 7ff8167fc640 1 --2- 172.21.15.133:0/1792302334 >> v2:172.21.15.156:3300/0 conn(0x7ff8180c8310 0x7ff818151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:36.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.326+0000 7ff815ffb640 1 -- 172.21.15.133:0/1792302334 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518727947 0 0) 0x7ff81815a9d0 con 0x7ff8180c7f30 2024-01-19T05:01:36.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.326+0000 7ff815ffb640 1 -- 172.21.15.133:0/1792302334 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff804003530 con 0x7ff8180c7f30 2024-01-19T05:01:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.334+0000 7ff8167fc640 1 -- 172.21.15.133:0/1792302334 >> v1:172.21.15.156:6789/0 conn(0x7ff818071970 legacy=0x7ff81815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.334+0000 7ff8167fc640 1 -- 172.21.15.133:0/1792302334 >> v1:172.21.15.133:6789/0 conn(0x7ff8180c7f30 legacy=0x7ff81806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.334+0000 7ff8167fc640 1 -- 172.21.15.133:0/1792302334 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8181576a0 con 0x7ff8180c8310 2024-01-19T05:01:36.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.346+0000 7ff8167fc640 1 --2- 172.21.15.133:0/1792302334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c8310 0x7ff818151190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8000097c0 tx=0x7ff80001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67b9b3e602f5879 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:36.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.362+0000 7ff815ffb640 1 -- 172.21.15.133:0/1792302334 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000a8970 con 0x7ff8180c8310 2024-01-19T05:01:36.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff815ffb640 1 -- 172.21.15.133:0/1792302334 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8000a8ad0 con 0x7ff8180c8310 2024-01-19T05:01:36.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff815ffb640 1 -- 172.21.15.133:0/1792302334 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000a8e60 con 0x7ff8180c8310 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- 172.21.15.133:0/1792302334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c8310 msgr2=0x7ff818151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/1792302334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c8310 0x7ff818151190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8000097c0 tx=0x7ff80001ec70 comp rx=0 tx=0).stop 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- 172.21.15.133:0/1792302334 shutdown_connections 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/1792302334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c8310 0x7ff818151190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- 172.21.15.133:0/1792302334 >> 172.21.15.133:0/1792302334 conn(0x7ff81806aa60 msgr2=0x7ff81806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- 172.21.15.133:0/1792302334 shutdown_connections 2024-01-19T05:01:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- 172.21.15.133:0/1792302334 wait complete. 2024-01-19T05:01:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 Processor -- start 2024-01-19T05:01:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- start start 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 0x7ff81815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c7f30 0x7ff81814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8180c8310 0x7ff8180c0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181506e0 con 0x7ff818071970 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81815a920 con 0x7ff8180c7f30 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.366+0000 7ff81d4ff640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81814f610 con 0x7ff8180c8310 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.370+0000 7ff816ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 0x7ff81815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.370+0000 7ff816ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 0x7ff81815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46064/0 (socket says 172.21.15.133:46064) 2024-01-19T05:01:36.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.370+0000 7ff816ffd640 1 -- 172.21.15.133:0/470084663 learned_addr learned my addr 172.21.15.133:0/470084663 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.370+0000 7ff8177fe640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8180c8310 0x7ff8180c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.374+0000 7ff816ffd640 1 -- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8180c8310 msgr2=0x7ff8180c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.374+0000 7ff816ffd640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8180c8310 0x7ff8180c0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.374+0000 7ff816ffd640 1 -- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c7f30 msgr2=0x7ff81814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.374+0000 7ff816ffd640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c7f30 0x7ff81814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.374+0000 7ff816ffd640 1 -- 172.21.15.133:0/470084663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009420 con 0x7ff818071970 2024-01-19T05:01:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.374+0000 7ff816ffd640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 0x7ff81815a3e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c500 tx=0x7ff81000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.378+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810005cf0 con 0x7ff818071970 2024-01-19T05:01:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.378+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810005e50 con 0x7ff818071970 2024-01-19T05:01:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.378+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100072f0 con 0x7ff818071970 2024-01-19T05:01:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.378+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8181509c0 con 0x7ff818071970 2024-01-19T05:01:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.378+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff818150400 con 0x7ff818071970 2024-01-19T05:01:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.382+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff818074340 con 0x7ff818071970 2024-01-19T05:01:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.402+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff810007450 con 0x7ff818071970 2024-01-19T05:01:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.402+0000 7ff80f7fe640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff7f8066550 0x7ff7f8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:36.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.402+0000 7ff8167fc640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff7f8066550 0x7ff7f8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:36.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.402+0000 7ff8167fc640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff7f8066550 0x7ff7f8068a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b2000 tx=0x7ff800004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:36.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.690+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff810054990 con 0x7ff818071970 2024-01-19T05:01:36.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.690+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff810050cd0 con 0x7ff818071970 2024-01-19T05:01:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.898+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff818146ed0 con 0x7ff818071970 2024-01-19T05:01:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff80f7fe640 1 -- 172.21.15.133:0/470084663 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff810021080 con 0x7ff818071970 2024-01-19T05:01:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-01-19T05:01:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff7f8066550 msgr2=0x7ff7f8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff7f8066550 0x7ff7f8068a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b2000 tx=0x7ff800004740 comp rx=0 tx=0).stop 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 msgr2=0x7ff81815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 0x7ff81815a3e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c500 tx=0x7ff81000c9c0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 shutdown_connections 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ff7f8066550 0x7ff7f8068a10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8180c7f30 0x7ff81814fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8180c8310 0x7ff8180c0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 --2- 172.21.15.133:0/470084663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff818071970 0x7ff81815a3e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 >> 172.21.15.133:0/470084663 conn(0x7ff81806aa60 msgr2=0x7ff81806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 shutdown_connections 2024-01-19T05:01:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:36.910+0000 7ff81d4ff640 1 -- 172.21.15.133:0/470084663 wait complete. 2024-01-19T05:01:36.929 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-19T05:01:36.929 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:01:36.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:01:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 Processor -- start 2024-01-19T05:01:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 -- start start 2024-01-19T05:01:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32ac1519e0 0x7f32ac15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac158390 con 0x7f32ac151600 2024-01-19T05:01:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac15b0e0 con 0x7f32ac1519e0 2024-01-19T05:01:37.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b32f5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac157b70 con 0x7f32ac06f350 2024-01-19T05:01:37.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b0890640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32ac1519e0 0x7f32ac15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b1091640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f32ac151600 0x7f32ac157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51650/0 (socket says 172.21.15.133:51650) 2024-01-19T05:01:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b1091640 1 -- 172.21.15.133:0/1853045865 learned_addr learned my addr 172.21.15.133:0/1853045865 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.098+0000 7f32b1892640 1 --2- 172.21.15.133:0/1853045865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.106+0000 7f32b0890640 1 -- 172.21.15.133:0/1853045865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 msgr2=0x7f32ac0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.106+0000 7f32b0890640 1 --2- 172.21.15.133:0/1853045865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.106+0000 7f32b0890640 1 -- 172.21.15.133:0/1853045865 >> v1:172.21.15.133:6789/0 conn(0x7f32ac151600 legacy=0x7f32ac157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.106+0000 7f32b0890640 1 -- 172.21.15.133:0/1853045865 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac157dd0 con 0x7f32ac1519e0 2024-01-19T05:01:37.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.110+0000 7f32b0890640 1 --2- 172.21.15.133:0/1853045865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac1519e0 0x7f32ac15b570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097c0 tx=0x7f329c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755dea5cfc151684 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:37.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.110+0000 7f32a3fff640 1 -- 172.21.15.133:0/1853045865 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0ab600 con 0x7f32ac1519e0 2024-01-19T05:01:37.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.110+0000 7f32a3fff640 1 -- 172.21.15.133:0/1853045865 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c0a7050 con 0x7f32ac1519e0 2024-01-19T05:01:37.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.110+0000 7f32a3fff640 1 -- 172.21.15.133:0/1853045865 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0ab980 con 0x7f32ac1519e0 2024-01-19T05:01:37.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- 172.21.15.133:0/1853045865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac1519e0 msgr2=0x7f32ac15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1853045865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac1519e0 0x7f32ac15b570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097c0 tx=0x7f329c01c3f0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- 172.21.15.133:0/1853045865 shutdown_connections 2024-01-19T05:01:37.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1853045865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1853045865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac1519e0 0x7f32ac15b570 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- 172.21.15.133:0/1853045865 >> 172.21.15.133:0/1853045865 conn(0x7f32ac06d590 msgr2=0x7f32ac066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:37.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- 172.21.15.133:0/1853045865 shutdown_connections 2024-01-19T05:01:37.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- 172.21.15.133:0/1853045865 wait complete. 2024-01-19T05:01:37.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 Processor -- start 2024-01-19T05:01:37.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- start start 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ac151600 0x7f32ac142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 0x7f32ac145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac14c430 con 0x7f32ac144cc0 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0c42c0 con 0x7f32ac151600 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b32f5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac144830 con 0x7f32ac06f350 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b1892640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 0x7f32ac145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b1892640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 0x7f32ac145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46076/0 (socket says 172.21.15.133:46076) 2024-01-19T05:01:37.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.114+0000 7f32b1892640 1 -- 172.21.15.133:0/1141214073 learned_addr learned my addr 172.21.15.133:0/1141214073 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:37.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b0890640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ac151600 0x7f32ac142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b1091640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b1892640 1 -- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 msgr2=0x7f32ac141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b1892640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b1892640 1 -- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ac151600 msgr2=0x7f32ac142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b1892640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ac151600 0x7f32ac142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.118+0000 7f32b1892640 1 -- 172.21.15.133:0/1141214073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c009420 con 0x7f32ac144cc0 2024-01-19T05:01:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.122+0000 7f32b1892640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 0x7f32ac145140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32a400efc0 tx=0x7f32a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.126+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4009ba0 con 0x7f32ac144cc0 2024-01-19T05:01:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.126+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400f040 con 0x7f32ac144cc0 2024-01-19T05:01:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.126+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac1406e0 con 0x7f32ac144cc0 2024-01-19T05:01:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.126+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40146c0 con 0x7f32ac144cc0 2024-01-19T05:01:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.126+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac140980 con 0x7f32ac144cc0 2024-01-19T05:01:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.126+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac071fa0 con 0x7f32ac144cc0 2024-01-19T05:01:37.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.398+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f32a4014820 con 0x7f32ac144cc0 2024-01-19T05:01:37.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.398+0000 7f32a1ffb640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3290066550 0x7f3290068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.398+0000 7f32b1091640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3290066550 0x7f3290068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.398+0000 7f32b1091640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3290066550 0x7f3290068a10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f32a8000f70 tx=0x7f32a8007e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:37.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.410+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32a4055fe0 con 0x7f32ac144cc0 2024-01-19T05:01:37.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.410+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f32a4052320 con 0x7f32ac144cc0 2024-01-19T05:01:37.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.578+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32ac074340 con 0x7f32ac144cc0 2024-01-19T05:01:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32a1ffb640 1 -- 172.21.15.133:0/1141214073 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18782 (secure 0 0 0) 0x7f32a4018020 con 0x7f32ac144cc0 2024-01-19T05:01:37.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:01:37.680 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":31,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:32:36.898530+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3290066550 msgr2=0x7f3290068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3290066550 0x7f3290068a10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f32a8000f70 tx=0x7f32a8007e90 comp rx=0 tx=0).stop 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 msgr2=0x7f32ac145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 0x7f32ac145140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32a400efc0 tx=0x7f32a400c490 comp rx=0 tx=0).stop 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 shutdown_connections 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3290066550 0x7f3290068a10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ac151600 0x7f32ac142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac144cc0 0x7f32ac145140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 --2- 172.21.15.133:0/1141214073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ac06f350 0x7f32ac141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 >> 172.21.15.133:0/1141214073 conn(0x7f32ac06d590 msgr2=0x7f32ac0c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 shutdown_connections 2024-01-19T05:01:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.682+0000 7f32b32f5640 1 -- 172.21.15.133:0/1141214073 wait complete. 2024-01-19T05:01:37.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:30:46.253162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:31:30.230778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:31:31.446896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-19T04:31:37.539878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-19T05:01:37.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:01:37.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 Processor -- start 2024-01-19T05:01:37.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 -- start start 2024-01-19T05:01:37.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7da4150500 0x7f7da40c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da406e460 0x7f7da415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da4156a20 con 0x7f7da40c2e00 2024-01-19T05:01:37.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da4156d00 con 0x7f7da4150500 2024-01-19T05:01:37.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da8c79640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4156fe0 con 0x7f7da406e460 2024-01-19T05:01:37.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7da4150500 0x7f7da40c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7da4150500 0x7f7da40c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46088/0 (socket says 172.21.15.133:46088) 2024-01-19T05:01:37.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.842+0000 7f7da259c640 1 -- 172.21.15.133:0/3353759724 learned_addr learned my addr 172.21.15.133:0/3353759724 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.846+0000 7f7da259c640 1 -- 172.21.15.133:0/3353759724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da406e460 msgr2=0x7f7da415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.846+0000 7f7da259c640 1 --2- 172.21.15.133:0/3353759724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da406e460 0x7f7da415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.846+0000 7f7da259c640 1 -- 172.21.15.133:0/3353759724 >> v1:172.21.15.156:6789/0 conn(0x7f7da40c2e00 legacy=0x7f7da4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.846+0000 7f7da259c640 1 -- 172.21.15.133:0/3353759724 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da41599e0 con 0x7f7da4150500 2024-01-19T05:01:37.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.850+0000 7f7da259c640 1 --2- 172.21.15.133:0/3353759724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da4150500 0x7f7da40c5f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7da40c9a30 tx=0x7f7d940213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1308f148940e2da2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da159a640 1 -- 172.21.15.133:0/3353759724 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940b1600 con 0x7f7da4150500 2024-01-19T05:01:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da159a640 1 -- 172.21.15.133:0/3353759724 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d940ad050 con 0x7f7da4150500 2024-01-19T05:01:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da159a640 1 -- 172.21.15.133:0/3353759724 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940b1980 con 0x7f7da4150500 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 -- 172.21.15.133:0/3353759724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da4150500 msgr2=0x7f7da40c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 --2- 172.21.15.133:0/3353759724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da4150500 0x7f7da40c5f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7da40c9a30 tx=0x7f7d940213a0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 -- 172.21.15.133:0/3353759724 shutdown_connections 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 --2- 172.21.15.133:0/3353759724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da406e460 0x7f7da415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 --2- 172.21.15.133:0/3353759724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da4150500 0x7f7da40c5f20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 -- 172.21.15.133:0/3353759724 >> 172.21.15.133:0/3353759724 conn(0x7f7da406b770 msgr2=0x7f7da406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 -- 172.21.15.133:0/3353759724 shutdown_connections 2024-01-19T05:01:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.854+0000 7f7da8c79640 1 -- 172.21.15.133:0/3353759724 wait complete. 2024-01-19T05:01:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 Processor -- start 2024-01-19T05:01:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 -- start start 2024-01-19T05:01:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 0x7f7da41542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da40c2e00 0x7f7da41e0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7da4150500 0x7f7da40cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4154810 con 0x7f7da406e460 2024-01-19T05:01:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da414f670 con 0x7f7da4150500 2024-01-19T05:01:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da8c79640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da41e0af0 con 0x7f7da40c2e00 2024-01-19T05:01:37.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 0x7f7da41542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:37.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 0x7f7da41542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46098/0 (socket says 172.21.15.133:46098) 2024-01-19T05:01:37.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.858+0000 7f7da259c640 1 -- 172.21.15.133:0/1563498142 learned_addr learned my addr 172.21.15.133:0/1563498142 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.862+0000 7f7da259c640 1 -- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da40c2e00 msgr2=0x7f7da41e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.862+0000 7f7da259c640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da40c2e00 0x7f7da41e0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.862+0000 7f7da259c640 1 -- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7da4150500 msgr2=0x7f7da40cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.862+0000 7f7da259c640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7da4150500 0x7f7da40cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.862+0000 7f7da259c640 1 -- 172.21.15.133:0/1563498142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9400b770 con 0x7f7da406e460 2024-01-19T05:01:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.866+0000 7f7da259c640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 0x7f7da41542d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400b2c0 tx=0x7f7d9401e140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:37.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.870+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940bb670 con 0x7f7da406e460 2024-01-19T05:01:37.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.870+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d940bb7d0 con 0x7f7da406e460 2024-01-19T05:01:37.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.870+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940bbb80 con 0x7f7da406e460 2024-01-19T05:01:37.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.870+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da41e1d20 con 0x7f7da406e460 2024-01-19T05:01:37.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.870+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da41e1f90 con 0x7f7da406e460 2024-01-19T05:01:37.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:37.870+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da4074340 con 0x7f7da406e460 2024-01-19T05:01:38.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.126+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7d940b8040 con 0x7f7da406e460 2024-01-19T05:01:38.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.126+0000 7f7d92ffd640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7d84066550 0x7f7d84068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.126+0000 7f7da1d9b640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7d84066550 0x7f7d84068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.126+0000 7f7da1d9b640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7d84066550 0x7f7d84068a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d98007fd0 tx=0x7f7d980079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:38.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.138+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d940f64f0 con 0x7f7da406e460 2024-01-19T05:01:38.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.138+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7d940f2130 con 0x7f7da406e460 2024-01-19T05:01:38.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.310+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7da40c7850 con 0x7f7da406e460 2024-01-19T05:01:38.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7d92ffd640 1 -- 172.21.15.133:0/1563498142 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d940b6070 con 0x7f7da406e460 2024-01-19T05:01:38.352 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7d84066550 msgr2=0x7f7d84068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7d84066550 0x7f7d84068a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d98007fd0 tx=0x7f7d980079a0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 msgr2=0x7f7da41542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 0x7f7da41542d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400b2c0 tx=0x7f7d9401e140 comp rx=0 tx=0).stop 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 shutdown_connections 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7d84066550 0x7f7d84068a10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7da4150500 0x7f7da40cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7da40c2e00 0x7f7da41e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 --2- 172.21.15.133:0/1563498142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7da406e460 0x7f7da41542d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 >> 172.21.15.133:0/1563498142 conn(0x7f7da406b770 msgr2=0x7f7da40c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:38.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 shutdown_connections 2024-01-19T05:01:38.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.354+0000 7f7da8c79640 1 -- 172.21.15.133:0/1563498142 wait complete. 2024-01-19T05:01:38.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:01:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.494+0000 7f3a4f351640 1 Processor -- start 2024-01-19T05:01:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.494+0000 7f3a4f351640 1 -- start start 2024-01-19T05:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4f351640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a481503c0 0x7f3a480c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4f351640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a48072760 0x7f3a48156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4f351640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a480c7cd0 0x7f3a480c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4f351640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a48156760 con 0x7f3a481503c0 2024-01-19T05:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4f351640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a481507a0 con 0x7f3a48072760 2024-01-19T05:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4f351640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48071a10 con 0x7f3a480c7cd0 2024-01-19T05:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4d0ed640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a481503c0 0x7f3a480c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4d0ed640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a481503c0 0x7f3a480c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46112/0 (socket says 172.21.15.133:46112) 2024-01-19T05:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4d0ed640 1 -- 172.21.15.133:0/2907039216 learned_addr learned my addr 172.21.15.133:0/2907039216 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4c8ec640 1 --2- 172.21.15.133:0/2907039216 >> v2:172.21.15.156:3300/0 conn(0x7f3a48072760 0x7f3a48156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.498+0000 7f3a4d8ee640 1 --2- 172.21.15.133:0/2907039216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a480c7cd0 0x7f3a480c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.502+0000 7f3a4d0ed640 1 -- 172.21.15.133:0/2907039216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a480c7cd0 msgr2=0x7f3a480c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.502+0000 7f3a4d0ed640 1 --2- 172.21.15.133:0/2907039216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a480c7cd0 0x7f3a480c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.502+0000 7f3a4d0ed640 1 -- 172.21.15.133:0/2907039216 >> v2:172.21.15.156:3300/0 conn(0x7f3a48072760 msgr2=0x7f3a48156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.502+0000 7f3a4d0ed640 1 --2- 172.21.15.133:0/2907039216 >> v2:172.21.15.156:3300/0 conn(0x7f3a48072760 0x7f3a48156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.502+0000 7f3a4d0ed640 1 -- 172.21.15.133:0/2907039216 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48071cf0 con 0x7f3a481503c0 2024-01-19T05:01:38.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.506+0000 7f3a4d0ed640 1 --2- 172.21.15.133:0/2907039216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a480c57d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a48070670 tx=0x7f3a4401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada3f200963cf4f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a3ffff640 1 -- 172.21.15.133:0/2907039216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440a89b0 con 0x7f3a481503c0 2024-01-19T05:01:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a3ffff640 1 -- 172.21.15.133:0/2907039216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440a8b10 con 0x7f3a481503c0 2024-01-19T05:01:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a3ffff640 1 -- 172.21.15.133:0/2907039216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440a8ea0 con 0x7f3a481503c0 2024-01-19T05:01:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 -- 172.21.15.133:0/2907039216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 msgr2=0x7f3a480c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2907039216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a480c57d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a48070670 tx=0x7f3a4401ecf0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 -- 172.21.15.133:0/2907039216 shutdown_connections 2024-01-19T05:01:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2907039216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a480c7cd0 0x7f3a480c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2907039216 >> v2:172.21.15.156:3300/0 conn(0x7f3a48072760 0x7f3a48156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2907039216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a480c57d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 -- 172.21.15.133:0/2907039216 >> 172.21.15.133:0/2907039216 conn(0x7f3a4806aa60 msgr2=0x7f3a4806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 -- 172.21.15.133:0/2907039216 shutdown_connections 2024-01-19T05:01:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.510+0000 7f3a4f351640 1 -- 172.21.15.133:0/2907039216 wait complete. 2024-01-19T05:01:38.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 Processor -- start 2024-01-19T05:01:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 -- start start 2024-01-19T05:01:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a48072760 0x7f3a4814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a480c7cd0 0x7f3a480c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a4813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481454c0 con 0x7f3a481503c0 2024-01-19T05:01:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480c99d0 con 0x7f3a480c7cd0 2024-01-19T05:01:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4f351640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48145f10 con 0x7f3a48072760 2024-01-19T05:01:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4d8ee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a4813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4d8ee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a4813b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46120/0 (socket says 172.21.15.133:46120) 2024-01-19T05:01:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4d8ee640 1 -- 172.21.15.133:0/2469691112 learned_addr learned my addr 172.21.15.133:0/2469691112 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:38.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4c8ec640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a480c7cd0 0x7f3a480c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.514+0000 7f3a4d0ed640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a48072760 0x7f3a4814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.518+0000 7f3a4d8ee640 1 -- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a48072760 msgr2=0x7f3a4814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.518+0000 7f3a4d8ee640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a48072760 0x7f3a4814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.518+0000 7f3a4d8ee640 1 -- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a480c7cd0 msgr2=0x7f3a480c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.518+0000 7f3a4d8ee640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a480c7cd0 0x7f3a480c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.518+0000 7f3a4d8ee640 1 -- 172.21.15.133:0/2469691112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440094d0 con 0x7f3a481503c0 2024-01-19T05:01:38.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.522+0000 7f3a4d8ee640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a4813b7b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a40007e70 tx=0x7f3a4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:38.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.526+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40014620 con 0x7f3a481503c0 2024-01-19T05:01:38.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.526+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a400147a0 con 0x7f3a481503c0 2024-01-19T05:01:38.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.526+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40014b50 con 0x7f3a481503c0 2024-01-19T05:01:38.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.526+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a480ca720 con 0x7f3a481503c0 2024-01-19T05:01:38.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.526+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a480c9c20 con 0x7f3a481503c0 2024-01-19T05:01:38.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.526+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a480c8cb0 con 0x7f3a481503c0 2024-01-19T05:01:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.546+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3a40014cb0 con 0x7f3a481503c0 2024-01-19T05:01:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.546+0000 7f3a3dffb640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3a2c066550 0x7f3a2c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.546+0000 7f3a4d0ed640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3a2c066550 0x7f3a2c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.546+0000 7f3a4d0ed640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3a2c066550 0x7f3a2c068a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a440b2000 tx=0x7f3a440aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:38.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.814+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a400563e0 con 0x7f3a481503c0 2024-01-19T05:01:38.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.814+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3a40052720 con 0x7f3a481503c0 2024-01-19T05:01:38.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.982+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a480c8cb0 con 0x7f3a481503c0 2024-01-19T05:01:38.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a3dffb640 1 -- 172.21.15.133:0/2469691112 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a480c8cb0 con 0x7f3a481503c0 2024-01-19T05:01:38.996 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3a2c066550 msgr2=0x7f3a2c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3a2c066550 0x7f3a2c068a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a440b2000 tx=0x7f3a440aa070 comp rx=0 tx=0).stop 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 msgr2=0x7f3a4813b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a4813b7b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a40007e70 tx=0x7f3a4000e4b0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 shutdown_connections 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f3a2c066550 0x7f3a2c068a10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a480c7cd0 0x7f3a480c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a481503c0 0x7f3a4813b7b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:38.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 --2- 172.21.15.133:0/2469691112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a48072760 0x7f3a4814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 >> 172.21.15.133:0/2469691112 conn(0x7f3a4806aa60 msgr2=0x7f3a480c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:39.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 shutdown_connections 2024-01-19T05:01:39.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:38.998+0000 7f3a4f351640 1 -- 172.21.15.133:0/2469691112 wait complete. 2024-01-19T05:01:39.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:01:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.138+0000 7efeb6c53640 1 Processor -- start 2024-01-19T05:01:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.138+0000 7efeb6c53640 1 -- start start 2024-01-19T05:01:39.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb6c53640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efeb00c7f30 0x7efeb006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb6c53640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb01518a0 0x7efeb015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb6c53640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb015a9d0 con 0x7efeb006dfd0 2024-01-19T05:01:39.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb6c53640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb01573e0 con 0x7efeb00c7f30 2024-01-19T05:01:39.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb6c53640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01576a0 con 0x7efeb01518a0 2024-01-19T05:01:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb49ef640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efeb00c7f30 0x7efeb006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb49ef640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efeb00c7f30 0x7efeb006da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46136/0 (socket says 172.21.15.133:46136) 2024-01-19T05:01:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb49ef640 1 -- 172.21.15.133:0/3558760712 learned_addr learned my addr 172.21.15.133:0/3558760712 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.142+0000 7efeb51f0640 1 --2- 172.21.15.133:0/3558760712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb01518a0 0x7efeb015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.146+0000 7efeb49ef640 1 -- 172.21.15.133:0/3558760712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb01518a0 msgr2=0x7efeb015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.146+0000 7efeb49ef640 1 --2- 172.21.15.133:0/3558760712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb01518a0 0x7efeb015ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.146+0000 7efeb49ef640 1 -- 172.21.15.133:0/3558760712 >> v1:172.21.15.133:6789/0 conn(0x7efeb006dfd0 legacy=0x7efeb0151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.146+0000 7efeb49ef640 1 -- 172.21.15.133:0/3558760712 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0157980 con 0x7efeb00c7f30 2024-01-19T05:01:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.150+0000 7efeb49ef640 1 --2- 172.21.15.133:0/3558760712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb00c7f30 0x7efeb006da90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efea00098a0 tx=0x7efea001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3457b8cc05150c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:39.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeaf7fe640 1 -- 172.21.15.133:0/3558760712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00a8a10 con 0x7efeb00c7f30 2024-01-19T05:01:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeaf7fe640 1 -- 172.21.15.133:0/3558760712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea00a8b70 con 0x7efeb00c7f30 2024-01-19T05:01:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeaf7fe640 1 -- 172.21.15.133:0/3558760712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00b0440 con 0x7efeb00c7f30 2024-01-19T05:01:39.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 -- 172.21.15.133:0/3558760712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb00c7f30 msgr2=0x7efeb006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 --2- 172.21.15.133:0/3558760712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb00c7f30 0x7efeb006da90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efea00098a0 tx=0x7efea001ed10 comp rx=0 tx=0).stop 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 -- 172.21.15.133:0/3558760712 shutdown_connections 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 --2- 172.21.15.133:0/3558760712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb01518a0 0x7efeb015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 --2- 172.21.15.133:0/3558760712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb00c7f30 0x7efeb006da90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 -- 172.21.15.133:0/3558760712 >> 172.21.15.133:0/3558760712 conn(0x7efeb006aa60 msgr2=0x7efeb006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 -- 172.21.15.133:0/3558760712 shutdown_connections 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.154+0000 7efeb6c53640 1 -- 172.21.15.133:0/3558760712 wait complete. 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 Processor -- start 2024-01-19T05:01:39.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 -- start start 2024-01-19T05:01:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb006dfd0 0x7efeb01f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeb00c7f30 0x7efeb00c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb01518a0 0x7efeb00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00ca170 con 0x7efeb01518a0 2024-01-19T05:01:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00ca450 con 0x7efeb00c7f30 2024-01-19T05:01:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb6c53640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c9f00 con 0x7efeb006dfd0 2024-01-19T05:01:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeb49ef640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb006dfd0 0x7efeb01f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.158+0000 7efeaffff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeb00c7f30 0x7efeb00c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.162+0000 7efeb49ef640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb006dfd0 0x7efeb01f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:41014/0 (socket says 172.21.15.133:41014) 2024-01-19T05:01:39.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.162+0000 7efeb49ef640 1 -- 172.21.15.133:0/2349620500 learned_addr learned my addr 172.21.15.133:0/2349620500 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:39.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.162+0000 7efeb51f0640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb01518a0 0x7efeb00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.166+0000 7efeb51f0640 1 -- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb006dfd0 msgr2=0x7efeb01f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.166+0000 7efeb51f0640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb006dfd0 0x7efeb01f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.166+0000 7efeb51f0640 1 -- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeb00c7f30 msgr2=0x7efeb00c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.166+0000 7efeb51f0640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeb00c7f30 0x7efeb00c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.166+0000 7efeb51f0640 1 -- 172.21.15.133:0/2349620500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00094d0 con 0x7efeb01518a0 2024-01-19T05:01:39.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.170+0000 7efeb51f0640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb01518a0 0x7efeb00c8bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efea800eba0 tx=0x7efea800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:39.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.174+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800cd20 con 0x7efeb01518a0 2024-01-19T05:01:39.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.174+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800f040 con 0x7efeb01518a0 2024-01-19T05:01:39.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.174+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea80146c0 con 0x7efeb01518a0 2024-01-19T05:01:39.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.174+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb00c4050 con 0x7efeb01518a0 2024-01-19T05:01:39.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.174+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb00c2a30 con 0x7efeb01518a0 2024-01-19T05:01:39.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.174+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb00ca5c0 con 0x7efeb01518a0 2024-01-19T05:01:39.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.194+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efea8014820 con 0x7efeb01518a0 2024-01-19T05:01:39.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.194+0000 7efead7fa640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efe90066550 0x7efe90068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.194+0000 7efeb49ef640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efe90066550 0x7efe90068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.198+0000 7efeb49ef640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efe90066550 0x7efe90068a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efea001c940 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:39.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.198+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efea8055fe0 con 0x7efeb01518a0 2024-01-19T05:01:39.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.470+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efea8052320 con 0x7efeb01518a0 2024-01-19T05:01:39.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.654+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efeb0074340 con 0x7efeb01518a0 2024-01-19T05:01:39.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.666+0000 7efead7fa640 1 -- 172.21.15.133:0/2349620500 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7efea80180a0 con 0x7efeb01518a0 2024-01-19T05:01:39.666 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efe90066550 msgr2=0x7efe90068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efe90066550 0x7efe90068a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efea001c940 tx=0x7efea0009040 comp rx=0 tx=0).stop 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb01518a0 msgr2=0x7efeb00c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb01518a0 0x7efeb00c8bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efea800eba0 tx=0x7efea800c490 comp rx=0 tx=0).stop 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 shutdown_connections 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efe90066550 0x7efe90068a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeb00c7f30 0x7efeb00c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb01518a0 0x7efeb00c8bd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 --2- 172.21.15.133:0/2349620500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeb006dfd0 0x7efeb01f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 >> 172.21.15.133:0/2349620500 conn(0x7efeb006aa60 msgr2=0x7efeb0071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 shutdown_connections 2024-01-19T05:01:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.670+0000 7efeb6c53640 1 -- 172.21.15.133:0/2349620500 wait complete. 2024-01-19T05:01:39.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-19T05:01:39.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.826+0000 7f34db175640 1 Processor -- start 2024-01-19T05:01:39.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.826+0000 7f34db175640 1 -- start start 2024-01-19T05:01:39.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.830+0000 7f34db175640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d4151840 0x7f34d415b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.830+0000 7f34db175640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d40c7dd0 0x7f34d40ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.830+0000 7f34db175640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d40c8e10 con 0x7f34d40ca3a0 2024-01-19T05:01:39.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.830+0000 7f34db175640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40c9f10 con 0x7f34d40c7dd0 2024-01-19T05:01:39.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.830+0000 7f34db175640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c9040 con 0x7f34d4151840 2024-01-19T05:01:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.886+0000 7f34d9712640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d40c7dd0 0x7f34d40ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.886+0000 7f34d9712640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d40c7dd0 0x7f34d40ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46152/0 (socket says 172.21.15.133:46152) 2024-01-19T05:01:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.886+0000 7f34d9712640 1 -- 172.21.15.133:0/1316539388 learned_addr learned my addr 172.21.15.133:0/1316539388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.890+0000 7f34d9712640 1 -- 172.21.15.133:0/1316539388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d4151840 msgr2=0x7f34d415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.890+0000 7f34d9712640 1 --2- 172.21.15.133:0/1316539388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d4151840 0x7f34d415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.890+0000 7f34d9712640 1 -- 172.21.15.133:0/1316539388 >> v1:172.21.15.156:6789/0 conn(0x7f34d40ca3a0 legacy=0x7f34d40c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.890+0000 7f34d9712640 1 -- 172.21.15.133:0/1316539388 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40c9300 con 0x7f34d40c7dd0 2024-01-19T05:01:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.894+0000 7f34d9712640 1 --2- 172.21.15.133:0/1316539388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d40c7dd0 0x7f34d40ccd10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009e50 tx=0x7f34cc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832ff00af3b3564a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:39.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34cb7fe640 1 -- 172.21.15.133:0/1316539388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0a5870 con 0x7f34d40c7dd0 2024-01-19T05:01:39.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34cb7fe640 1 -- 172.21.15.133:0/1316539388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc0a59d0 con 0x7f34d40c7dd0 2024-01-19T05:01:39.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34cb7fe640 1 -- 172.21.15.133:0/1316539388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0a5d60 con 0x7f34d40c7dd0 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 -- 172.21.15.133:0/1316539388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d40c7dd0 msgr2=0x7f34d40ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 --2- 172.21.15.133:0/1316539388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d40c7dd0 0x7f34d40ccd10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009e50 tx=0x7f34cc01c9d0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 -- 172.21.15.133:0/1316539388 shutdown_connections 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 --2- 172.21.15.133:0/1316539388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d40c7dd0 0x7f34d40ccd10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 --2- 172.21.15.133:0/1316539388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d4151840 0x7f34d415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 -- 172.21.15.133:0/1316539388 >> 172.21.15.133:0/1316539388 conn(0x7f34d406a660 msgr2=0x7f34d406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 -- 172.21.15.133:0/1316539388 shutdown_connections 2024-01-19T05:01:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.902+0000 7f34db175640 1 -- 172.21.15.133:0/1316539388 wait complete. 2024-01-19T05:01:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 Processor -- start 2024-01-19T05:01:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 -- start start 2024-01-19T05:01:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d40c7dd0 0x7f34d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d40ca3a0 0x7f34d41541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 0x7f34d4153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4154730 con 0x7f34d4151840 2024-01-19T05:01:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4152bd0 con 0x7f34d40c7dd0 2024-01-19T05:01:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.906+0000 7f34db175640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c4fb0 con 0x7f34d40ca3a0 2024-01-19T05:01:39.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.910+0000 7f34d9712640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 0x7f34d4153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:39.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.910+0000 7f34d9712640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 0x7f34d4153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46166/0 (socket says 172.21.15.133:46166) 2024-01-19T05:01:39.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.910+0000 7f34d9712640 1 -- 172.21.15.133:0/4168225426 learned_addr learned my addr 172.21.15.133:0/4168225426 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:39.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.914+0000 7f34d9712640 1 -- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d40ca3a0 msgr2=0x7f34d41541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.914+0000 7f34d9712640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d40ca3a0 0x7f34d41541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.914+0000 7f34d9712640 1 -- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d40c7dd0 msgr2=0x7f34d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.914+0000 7f34d9712640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d40c7dd0 0x7f34d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.914+0000 7f34d9712640 1 -- 172.21.15.133:0/4168225426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009b30 con 0x7f34d4151840 2024-01-19T05:01:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.918+0000 7f34d9712640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 0x7f34d4153060 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0af040 tx=0x7f34cc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.922+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0b8880 con 0x7f34d4151840 2024-01-19T05:01:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.922+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc0b8a00 con 0x7f34d4151840 2024-01-19T05:01:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.922+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0b8db0 con 0x7f34d4151840 2024-01-19T05:01:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.922+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d41522a0 con 0x7f34d4151840 2024-01-19T05:01:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.922+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d4152860 con 0x7f34d4151840 2024-01-19T05:01:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:39.922+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d40afe20 con 0x7f34d4151840 2024-01-19T05:01:40.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.214+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f34cc0cc430 con 0x7f34d4151840 2024-01-19T05:01:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.214+0000 7f34c97fa640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34c0066580 0x7f34c0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.214+0000 7f34d8f11640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34c0066580 0x7f34c0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.214+0000 7f34d8f11640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34c0066580 0x7f34c0068a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009690 tx=0x7f34d0006c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:40.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.242+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34cc0f1290 con 0x7f34d4151840 2024-01-19T05:01:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.242+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f34cc0eced0 con 0x7f34d4151840 2024-01-19T05:01:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.422+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f34d40afe20 con 0x7f34d4151840 2024-01-19T05:01:40.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.482+0000 7f34c97fa640 1 -- 172.21.15.133:0/4168225426 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f34cc0f04f0 con 0x7f34d4151840 2024-01-19T05:01:40.483 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2024-01-19T05:01:40.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34c0066580 msgr2=0x7f34c0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34c0066580 0x7f34c0068a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009690 tx=0x7f34d0006c00 comp rx=0 tx=0).stop 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 msgr2=0x7f34d4153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 0x7f34d4153060 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0af040 tx=0x7f34cc019770 comp rx=0 tx=0).stop 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 shutdown_connections 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f34c0066580 0x7f34c0068a40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d4151840 0x7f34d4153060 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34d40ca3a0 0x7f34d41541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 --2- 172.21.15.133:0/4168225426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34d40c7dd0 0x7f34d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 >> 172.21.15.133:0/4168225426 conn(0x7f34d406a660 msgr2=0x7f34d4158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 shutdown_connections 2024-01-19T05:01:40.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.486+0000 7f34db175640 1 -- 172.21.15.133:0/4168225426 wait complete. 2024-01-19T05:01:40.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T05:01:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 Processor -- start 2024-01-19T05:01:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 -- start start 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe484153b20 0x7fe4840c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 0x7fe4840c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4840c4c20 con 0x7fe4840724a0 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe484153f00 con 0x7fe484153b20 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe48a653640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840c4f00 con 0x7fe484159700 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe488bf0640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe4840724a0 0x7fe4840c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51660/0 (socket says 172.21.15.133:51660) 2024-01-19T05:01:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe488bf0640 1 -- 172.21.15.133:0/1658405659 learned_addr learned my addr 172.21.15.133:0/1658405659 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe483fff640 1 --2- 172.21.15.133:0/1658405659 >> v2:172.21.15.156:3300/0 conn(0x7fe484153b20 0x7fe4840c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.638+0000 7fe4837fe640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 0x7fe4840c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.642+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710076484 0 0) 0x7fe4840c4c20 con 0x7fe4840724a0 2024-01-19T05:01:40.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.642+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe46c003530 con 0x7fe4840724a0 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323405371 0 0) 0x7fe46c003530 con 0x7fe4840724a0 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 msgr2=0x7fe4840c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 0x7fe4840c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 >> v2:172.21.15.156:3300/0 conn(0x7fe484153b20 msgr2=0x7fe4840c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 --2- 172.21.15.133:0/1658405659 >> v2:172.21.15.156:3300/0 conn(0x7fe484153b20 0x7fe4840c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484159bb0 con 0x7fe4840724a0 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fe47c001a00 con 0x7fe4840724a0 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 >> v1:172.21.15.133:6789/0 conn(0x7fe4840724a0 legacy=0x7fe4840c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46c0039f0 0x7fe46c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe46c0047d0 0x7fe46c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 0x7fe46c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe484153f00 con 0x7fe46c0047d0 2024-01-19T05:01:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840c4f00 con 0x7fe46c0039f0 2024-01-19T05:01:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.646+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c00b9c0 con 0x7fe484159700 2024-01-19T05:01:40.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.650+0000 7fe4837fe640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe46c0047d0 0x7fe46c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.650+0000 7fe4837fe640 1 -- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 msgr2=0x7fe46c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.650+0000 7fe4837fe640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe484159700 0x7fe46c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.650+0000 7fe4837fe640 1 -- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46c0039f0 msgr2=0x7fe46c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.650+0000 7fe4837fe640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46c0039f0 0x7fe46c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.650+0000 7fe4837fe640 1 -- 172.21.15.133:0/1658405659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c003530 con 0x7fe46c0047d0 2024-01-19T05:01:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.654+0000 7fe4837fe640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe46c0047d0 0x7fe46c004c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe4840ccd70 tx=0x7fe47801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc2de612624052b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780059a0 con 0x7fe46c0047d0 2024-01-19T05:01:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478005b00 con 0x7fe46c0047d0 2024-01-19T05:01:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe482ffd640 1 -- 172.21.15.133:0/1658405659 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478005e70 con 0x7fe46c0047d0 2024-01-19T05:01:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe48a653640 1 -- 172.21.15.133:0/1658405659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe46c0047d0 msgr2=0x7fe46c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe48a653640 1 --2- 172.21.15.133:0/1658405659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe46c0047d0 0x7fe46c004c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe4840ccd70 tx=0x7fe47801ca10 comp rx=0 tx=0).stop 2024-01-19T05:01:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe488bf0640 1 -- 172.21.15.133:0/1658405659 reap_dead start 2024-01-19T05:01:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe48a653640 1 -- 172.21.15.133:0/1658405659 shutdown_connections 2024-01-19T05:01:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe48a653640 1 -- 172.21.15.133:0/1658405659 >> 172.21.15.133:0/1658405659 conn(0x7fe48406c1f0 msgr2=0x7fe484071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe48a653640 1 -- 172.21.15.133:0/1658405659 shutdown_connections 2024-01-19T05:01:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.658+0000 7fe48a653640 1 -- 172.21.15.133:0/1658405659 wait complete. 2024-01-19T05:01:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 Processor -- start 2024-01-19T05:01:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 -- start start 2024-01-19T05:01:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4841575c0 0x7fe4841579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 0x7fe48415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48415afa0 0x7fe484150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe484153450 con 0x7fe48415aa50 2024-01-19T05:01:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841570c0 con 0x7fe4841575c0 2024-01-19T05:01:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe48a653640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841583a0 con 0x7fe48415afa0 2024-01-19T05:01:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe4837fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 0x7fe48415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe4837fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 0x7fe48415b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46188/0 (socket says 172.21.15.133:46188) 2024-01-19T05:01:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe4837fe640 1 -- 172.21.15.133:0/2071637917 learned_addr learned my addr 172.21.15.133:0/2071637917 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe488bf0640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48415afa0 0x7fe484150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.662+0000 7fe483fff640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4841575c0 0x7fe4841579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.666+0000 7fe4837fe640 1 -- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48415afa0 msgr2=0x7fe484150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.666+0000 7fe4837fe640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48415afa0 0x7fe484150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.666+0000 7fe4837fe640 1 -- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4841575c0 msgr2=0x7fe4841579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.666+0000 7fe4837fe640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4841575c0 0x7fe4841579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.666+0000 7fe4837fe640 1 -- 172.21.15.133:0/2071637917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484153170 con 0x7fe48415aa50 2024-01-19T05:01:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.670+0000 7fe4837fe640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 0x7fe48415b4f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe47801d2b0 tx=0x7fe4780197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.674+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780059a0 con 0x7fe48415aa50 2024-01-19T05:01:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.674+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478006730 con 0x7fe48415aa50 2024-01-19T05:01:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.674+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780068a0 con 0x7fe48415aa50 2024-01-19T05:01:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.674+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe484156de0 con 0x7fe48415aa50 2024-01-19T05:01:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.674+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe484157ee0 con 0x7fe48415aa50 2024-01-19T05:01:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.674+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe484156c40 con 0x7fe48415aa50 2024-01-19T05:01:40.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.950+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe4780a5520 con 0x7fe48415aa50 2024-01-19T05:01:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.954+0000 7fe480ff9640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe470066580 0x7fe470068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.954+0000 7fe483fff640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe470066580 0x7fe470068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.954+0000 7fe483fff640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe470066580 0x7fe470068a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe474009be0 tx=0x7fe4740094c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.990+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4780f0270 con 0x7fe48415aa50 2024-01-19T05:01:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:40.990+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe4780ebeb0 con 0x7fe48415aa50 2024-01-19T05:01:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.166+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe484156c40 con 0x7fe48415aa50 2024-01-19T05:01:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.262+0000 7fe480ff9640 1 -- 172.21.15.133:0/2071637917 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe484156c40 con 0x7fe48415aa50 2024-01-19T05:01:41.263 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2024-01-19T05:01:41.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe470066580 msgr2=0x7fe470068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe470066580 0x7fe470068a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe474009be0 tx=0x7fe4740094c0 comp rx=0 tx=0).stop 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 msgr2=0x7fe48415b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 0x7fe48415b4f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe47801d2b0 tx=0x7fe4780197b0 comp rx=0 tx=0).stop 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 shutdown_connections 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe470066580 0x7fe470068a40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe48415afa0 0x7fe484150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48415aa50 0x7fe48415b4f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 --2- 172.21.15.133:0/2071637917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4841575c0 0x7fe4841579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 >> 172.21.15.133:0/2071637917 conn(0x7fe48406c1f0 msgr2=0x7fe4840ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 shutdown_connections 2024-01-19T05:01:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:41.266+0000 7fe48a653640 1 -- 172.21.15.133:0/2071637917 wait complete. 2024-01-19T05:01:41.288 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2024-01-19T05:01:41.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:01:41.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-19T05:01:41.302 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:01:41.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[35475]: fuse finished with error 0 and tester_r 0 2024-01-19T05:01:42.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:==00:00:28:58.810 35475== 2024-01-19T05:01:42.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:==00:00:28:58.810 35475== Exit program on first error (--exit-on-first-error=yes) 2024-01-19T05:01:42.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:daemon-helper: command failed with exit status 42 2024-01-19T05:01:45.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:01:45.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:01:47.406 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-19T05:01:47.407 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T05:01:47.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:01:47.407 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T05:01:47.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:01:47.415 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-19T05:01:47.464 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T05:01:47.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:01:47.465 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:01:47.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:01:47.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-01-19T05:01:47.702 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-19T05:01:47.711 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-19T05:01:47.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:01:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 Processor -- start 2024-01-19T05:01:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 -- start start 2024-01-19T05:01:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a080c93d0 0x7f3a0806a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a080c1970 0x7f3a080c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0815a7a0 con 0x7f3a080c67e0 2024-01-19T05:01:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080c97b0 con 0x7f3a080c1970 2024-01-19T05:01:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.846+0000 7f3a10707640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a081598f0 con 0x7f3a080c93d0 2024-01-19T05:01:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.898+0000 7f3a0eca4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a080c1970 0x7f3a080c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.898+0000 7f3a0eca4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a080c1970 0x7f3a080c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33696/0 (socket says 172.21.15.133:33696) 2024-01-19T05:01:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.898+0000 7f3a0eca4640 1 -- 172.21.15.133:0/1269289244 learned_addr learned my addr 172.21.15.133:0/1269289244 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:47.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.902+0000 7f3a0eca4640 1 -- 172.21.15.133:0/1269289244 >> v2:172.21.15.156:3300/0 conn(0x7f3a080c93d0 msgr2=0x7f3a0806a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:47.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.902+0000 7f3a0eca4640 1 --2- 172.21.15.133:0/1269289244 >> v2:172.21.15.156:3300/0 conn(0x7f3a080c93d0 0x7f3a0806a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:47.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.902+0000 7f3a0eca4640 1 -- 172.21.15.133:0/1269289244 >> v1:172.21.15.156:6789/0 conn(0x7f3a080c67e0 legacy=0x7f3a080723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:47.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.902+0000 7f3a0eca4640 1 -- 172.21.15.133:0/1269289244 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080c2300 con 0x7f3a080c1970 2024-01-19T05:01:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.910+0000 7f3a0eca4640 1 --2- 172.21.15.133:0/1269289244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a080c1dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a08070520 tx=0x7f3a0001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26262b850f4e4de0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a0d4a1640 1 -- 172.21.15.133:0/1269289244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000ab600 con 0x7f3a080c1970 2024-01-19T05:01:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a0d4a1640 1 -- 172.21.15.133:0/1269289244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a000a7050 con 0x7f3a080c1970 2024-01-19T05:01:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a0d4a1640 1 -- 172.21.15.133:0/1269289244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000ab980 con 0x7f3a080c1970 2024-01-19T05:01:47.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 -- 172.21.15.133:0/1269289244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 msgr2=0x7f3a080c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:47.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 --2- 172.21.15.133:0/1269289244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a080c1dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a08070520 tx=0x7f3a0001c4c0 comp rx=0 tx=0).stop 2024-01-19T05:01:47.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 -- 172.21.15.133:0/1269289244 shutdown_connections 2024-01-19T05:01:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 --2- 172.21.15.133:0/1269289244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a080c1dc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 --2- 172.21.15.133:0/1269289244 >> v2:172.21.15.156:3300/0 conn(0x7f3a080c93d0 0x7f3a0806a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 -- 172.21.15.133:0/1269289244 >> 172.21.15.133:0/1269289244 conn(0x7f3a0806de30 msgr2=0x7f3a0806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 -- 172.21.15.133:0/1269289244 shutdown_connections 2024-01-19T05:01:47.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.918+0000 7f3a10707640 1 -- 172.21.15.133:0/1269289244 wait complete. 2024-01-19T05:01:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 Processor -- start 2024-01-19T05:01:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 -- start start 2024-01-19T05:01:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a0815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a080c67e0 0x7f3a081577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a080c93d0 0x7f3a081f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815c690 con 0x7f3a080c1970 2024-01-19T05:01:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815b700 con 0x7f3a080c93d0 2024-01-19T05:01:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a10707640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815b270 con 0x7f3a080c67e0 2024-01-19T05:01:47.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a0e4a3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a0815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:47.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a0e4a3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a0815c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33704/0 (socket says 172.21.15.133:33704) 2024-01-19T05:01:47.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.922+0000 7f3a0e4a3640 1 -- 172.21.15.133:0/1846087763 learned_addr learned my addr 172.21.15.133:0/1846087763 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:47.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.930+0000 7f3a0e4a3640 1 -- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a080c67e0 msgr2=0x7f3a081577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:47.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.930+0000 7f3a0e4a3640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a080c67e0 0x7f3a081577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:47.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.930+0000 7f3a0e4a3640 1 -- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a080c93d0 msgr2=0x7f3a081f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:47.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.930+0000 7f3a0e4a3640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a080c93d0 0x7f3a081f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:47.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.930+0000 7f3a0e4a3640 1 -- 172.21.15.133:0/1846087763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000094d0 con 0x7f3a080c1970 2024-01-19T05:01:47.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.934+0000 7f3a0e4a3640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a0815c150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00ba50 tx=0x7f39fc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.938+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00cb60 con 0x7f3a080c1970 2024-01-19T05:01:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.938+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc00cce0 con 0x7f3a080c1970 2024-01-19T05:01:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.938+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0815d2a0 con 0x7f3a080c1970 2024-01-19T05:01:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.938+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc014680 con 0x7f3a080c1970 2024-01-19T05:01:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.938+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0815a940 con 0x7f3a080c1970 2024-01-19T05:01:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:47.942+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08074340 con 0x7f3a080c1970 2024-01-19T05:01:48.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.230+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f39fc01d3b0 con 0x7f3a080c1970 2024-01-19T05:01:48.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.230+0000 7f39faffd640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f39ec066550 0x7f39ec068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.230+0000 7f3a0dca2640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f39ec066550 0x7f39ec068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.234+0000 7f3a0dca2640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f39ec066550 0x7f39ec068a10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3a04007fd0 tx=0x7f3a040079a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:48.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.270+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39fc0558f0 con 0x7f3a080c1970 2024-01-19T05:01:48.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.270+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f39fc051530 con 0x7f3a080c1970 2024-01-19T05:01:48.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.454+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a0815a430 con 0x7f39ec066550 2024-01-19T05:01:48.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.486+0000 7f39faffd640 1 -- 172.21.15.133:0/1846087763 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369475 (secure 0 0 0) 0x7f3a040050d0 con 0x7f39ec066550 2024-01-19T05:01:48.490 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:01:48.493 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T05:01:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.490+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f39ec066550 msgr2=0x7f39ec068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.490+0000 7f3a10707640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f39ec066550 0x7f39ec068a10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3a04007fd0 tx=0x7f3a040079a0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.490+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 msgr2=0x7f3a0815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.490+0000 7f3a10707640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a0815c150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00ba50 tx=0x7f39fc00bf10 comp rx=0 tx=0).stop 2024-01-19T05:01:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 shutdown_connections 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f39ec066550 0x7f39ec068a10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a080c93d0 0x7f3a081f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a080c67e0 0x7f3a081577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 --2- 172.21.15.133:0/1846087763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a080c1970 0x7f3a0815c150 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 >> 172.21.15.133:0/1846087763 conn(0x7f3a0806de30 msgr2=0x7f3a080b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 shutdown_connections 2024-01-19T05:01:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.494+0000 7f3a10707640 1 -- 172.21.15.133:0/1846087763 wait complete. 2024-01-19T05:01:48.510 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":958,"stamp":"2024-01-19T05:01:48.414209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24694169,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":677,"num_read_kb":685,"num_write":8230,"num_write_kb":283324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9465,"ondisk_log_size":9465,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326848,"kb_used_data":51072,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754647872,"statfs":{"total":773094113280,"available":772759420928,"internally_reserved":0,"allocated":52297728,"data_stored":50501458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":282316336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10660,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005489"},"pg_stats":[{"pgid":"2.1f","version":"31'645","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:05.126879+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T05:01:05.126879+0000","last_peered":"2024-01-19T05:01:05.126879+0000","last_clean":"2024-01-19T05:01:05.126879+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T05:01:05.126879+0000","last_undegraded":"2024-01-19T05:01:05.126879+0000","last_fullsized":"2024-01-19T05:01:05.126879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.885215+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T05:01:41.885215+0000","last_peered":"2024-01-19T05:01:41.885215+0000","last_clean":"2024-01-19T05:01:41.885215+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T05:01:41.885215+0000","last_undegraded":"2024-01-19T05:01:41.885215+0000","last_fullsized":"2024-01-19T05:01:41.885215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456294+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T05:00:39.456294+0000","last_peered":"2024-01-19T05:00:39.456294+0000","last_clean":"2024-01-19T05:00:39.456294+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T05:00:39.456294+0000","last_undegraded":"2024-01-19T05:00:39.456294+0000","last_fullsized":"2024-01-19T05:00:39.456294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'262","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:42.127587+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T05:01:42.127587+0000","last_peered":"2024-01-19T05:01:42.127587+0000","last_clean":"2024-01-19T05:01:42.127587+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T05:01:42.127587+0000","last_undegraded":"2024-01-19T05:01:42.127587+0000","last_fullsized":"2024-01-19T05:01:42.127587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2994311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891716+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T05:01:41.891716+0000","last_peered":"2024-01-19T05:01:41.891716+0000","last_clean":"2024-01-19T05:01:41.891716+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T05:01:41.891716+0000","last_undegraded":"2024-01-19T05:01:41.891716+0000","last_fullsized":"2024-01-19T05:01:41.891716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'79","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.912319+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T05:00:36.912319+0000","last_peered":"2024-01-19T05:00:36.912319+0000","last_clean":"2024-01-19T05:00:36.912319+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T05:00:36.912319+0000","last_undegraded":"2024-01-19T05:00:36.912319+0000","last_fullsized":"2024-01-19T05:00:36.912319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.961414+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T05:01:21.961414+0000","last_peered":"2024-01-19T05:01:21.961414+0000","last_clean":"2024-01-19T05:01:21.961414+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T05:01:21.961414+0000","last_undegraded":"2024-01-19T05:01:21.961414+0000","last_fullsized":"2024-01-19T05:01:21.961414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'21","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.818570+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T05:01:41.818570+0000","last_peered":"2024-01-19T05:01:41.818570+0000","last_clean":"2024-01-19T05:01:41.818570+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T05:01:41.818570+0000","last_undegraded":"2024-01-19T05:01:41.818570+0000","last_fullsized":"2024-01-19T05:01:41.818570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'86","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400126+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T05:00:39.400126+0000","last_peered":"2024-01-19T05:00:39.400126+0000","last_clean":"2024-01-19T05:00:39.400126+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T05:00:39.400126+0000","last_undegraded":"2024-01-19T05:00:39.400126+0000","last_fullsized":"2024-01-19T05:00:39.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.159984+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T05:01:27.159984+0000","last_peered":"2024-01-19T05:01:27.159984+0000","last_clean":"2024-01-19T05:01:27.159984+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T05:01:27.159984+0000","last_undegraded":"2024-01-19T05:01:27.159984+0000","last_fullsized":"2024-01-19T05:01:27.159984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.808509+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T05:01:41.808509+0000","last_peered":"2024-01-19T05:01:41.808509+0000","last_clean":"2024-01-19T05:01:41.808509+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T05:01:41.808509+0000","last_undegraded":"2024-01-19T05:01:41.808509+0000","last_fullsized":"2024-01-19T05:01:41.808509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'85","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.439380+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T05:00:37.439380+0000","last_peered":"2024-01-19T05:00:37.439380+0000","last_clean":"2024-01-19T05:00:37.439380+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T05:00:37.439380+0000","last_undegraded":"2024-01-19T05:00:37.439380+0000","last_fullsized":"2024-01-19T05:00:37.439380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983091+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T05:01:41.983091+0000","last_peered":"2024-01-19T05:01:41.983091+0000","last_clean":"2024-01-19T05:01:41.983091+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T05:01:41.983091+0000","last_undegraded":"2024-01-19T05:01:41.983091+0000","last_fullsized":"2024-01-19T05:01:41.983091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'676","reported_seq":711,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:25.018447+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T05:01:25.018447+0000","last_peered":"2024-01-19T05:01:25.018447+0000","last_clean":"2024-01-19T05:01:25.018447+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T05:01:25.018447+0000","last_undegraded":"2024-01-19T05:01:25.018447+0000","last_fullsized":"2024-01-19T05:01:25.018447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'66","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:35.377800+0000","last_change":"2024-01-19T04:32:37.510574+0000","last_active":"2024-01-19T05:00:35.377800+0000","last_peered":"2024-01-19T05:00:35.377800+0000","last_clean":"2024-01-19T05:00:35.377800+0000","last_became_active":"2024-01-19T04:32:37.509981+0000","last_became_peered":"2024-01-19T04:32:37.509981+0000","last_unstale":"2024-01-19T05:00:35.377800+0000","last_undegraded":"2024-01-19T05:00:35.377800+0000","last_fullsized":"2024-01-19T05:00:35.377800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:57:44.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895522+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T05:01:41.895522+0000","last_peered":"2024-01-19T05:01:41.895522+0000","last_clean":"2024-01-19T05:01:41.895522+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T05:01:41.895522+0000","last_undegraded":"2024-01-19T05:01:41.895522+0000","last_fullsized":"2024-01-19T05:01:41.895522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:57.737776+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T05:00:57.737776+0000","last_peered":"2024-01-19T05:00:57.737776+0000","last_clean":"2024-01-19T05:00:57.737776+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T05:00:57.737776+0000","last_undegraded":"2024-01-19T05:00:57.737776+0000","last_fullsized":"2024-01-19T05:00:57.737776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'75","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.777943+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T05:00:36.777943+0000","last_peered":"2024-01-19T05:00:36.777943+0000","last_clean":"2024-01-19T05:00:36.777943+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T05:00:36.777943+0000","last_undegraded":"2024-01-19T05:00:36.777943+0000","last_fullsized":"2024-01-19T05:00:36.777943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.888619+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T05:01:41.888619+0000","last_peered":"2024-01-19T05:01:41.888619+0000","last_clean":"2024-01-19T05:01:41.888619+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T05:01:41.888619+0000","last_undegraded":"2024-01-19T05:01:41.888619+0000","last_fullsized":"2024-01-19T05:01:41.888619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:54.689539+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T05:00:54.689539+0000","last_peered":"2024-01-19T05:00:54.689539+0000","last_clean":"2024-01-19T05:00:54.689539+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T05:00:54.689539+0000","last_undegraded":"2024-01-19T05:00:54.689539+0000","last_fullsized":"2024-01-19T05:00:54.689539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'84","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.128938+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T05:00:39.128938+0000","last_peered":"2024-01-19T05:00:39.128938+0000","last_clean":"2024-01-19T05:00:39.128938+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T05:00:39.128938+0000","last_undegraded":"2024-01-19T05:00:39.128938+0000","last_fullsized":"2024-01-19T05:00:39.128938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.129743+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T05:00:40.129743+0000","last_peered":"2024-01-19T05:00:40.129743+0000","last_clean":"2024-01-19T05:00:40.129743+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T05:00:40.129743+0000","last_undegraded":"2024-01-19T05:00:40.129743+0000","last_fullsized":"2024-01-19T05:00:40.129743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.960586+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T05:01:21.960586+0000","last_peered":"2024-01-19T05:01:21.960586+0000","last_clean":"2024-01-19T05:01:21.960586+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T05:01:21.960586+0000","last_undegraded":"2024-01-19T05:01:21.960586+0000","last_fullsized":"2024-01-19T05:01:21.960586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'64","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.178229+0000","last_change":"2024-01-19T04:32:37.173175+0000","last_active":"2024-01-19T05:00:40.178229+0000","last_peered":"2024-01-19T05:00:40.178229+0000","last_clean":"2024-01-19T05:00:40.178229+0000","last_became_active":"2024-01-19T04:32:37.172049+0000","last_became_peered":"2024-01-19T04:32:37.172049+0000","last_unstale":"2024-01-19T05:00:40.178229+0000","last_undegraded":"2024-01-19T05:00:40.178229+0000","last_fullsized":"2024-01-19T05:00:40.178229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:44:06.445358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880902+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T05:01:41.880902+0000","last_peered":"2024-01-19T05:01:41.880902+0000","last_clean":"2024-01-19T05:01:41.880902+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T05:01:41.880902+0000","last_undegraded":"2024-01-19T05:01:41.880902+0000","last_fullsized":"2024-01-19T05:01:41.880902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.160162+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T05:01:27.160162+0000","last_peered":"2024-01-19T05:01:27.160162+0000","last_clean":"2024-01-19T05:01:27.160162+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T05:01:27.160162+0000","last_undegraded":"2024-01-19T05:01:27.160162+0000","last_fullsized":"2024-01-19T05:01:27.160162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'70","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.078499+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T05:00:39.078499+0000","last_peered":"2024-01-19T05:00:39.078499+0000","last_clean":"2024-01-19T05:00:39.078499+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T05:00:39.078499+0000","last_undegraded":"2024-01-19T05:00:39.078499+0000","last_fullsized":"2024-01-19T05:00:39.078499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.883471+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T05:01:41.883471+0000","last_peered":"2024-01-19T05:01:41.883471+0000","last_clean":"2024-01-19T05:01:41.883471+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T05:01:41.883471+0000","last_undegraded":"2024-01-19T05:01:41.883471+0000","last_fullsized":"2024-01-19T05:01:41.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'338","reported_seq":372,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:35.559737+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T05:01:35.559737+0000","last_peered":"2024-01-19T05:01:35.559737+0000","last_clean":"2024-01-19T05:01:35.559737+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T05:01:35.559737+0000","last_undegraded":"2024-01-19T05:01:35.559737+0000","last_fullsized":"2024-01-19T05:01:35.559737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":914,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.935298+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T05:00:39.935298+0000","last_peered":"2024-01-19T05:00:39.935298+0000","last_clean":"2024-01-19T05:00:39.935298+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T05:00:39.935298+0000","last_undegraded":"2024-01-19T05:00:39.935298+0000","last_fullsized":"2024-01-19T05:00:39.935298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669743+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T05:01:41.669743+0000","last_peered":"2024-01-19T05:01:41.669743+0000","last_clean":"2024-01-19T05:01:41.669743+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T05:01:41.669743+0000","last_undegraded":"2024-01-19T05:01:41.669743+0000","last_fullsized":"2024-01-19T05:01:41.669743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'7","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:22.945763+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T05:01:22.945763+0000","last_peered":"2024-01-19T05:01:22.945763+0000","last_clean":"2024-01-19T05:01:22.945763+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T05:01:22.945763+0000","last_undegraded":"2024-01-19T05:01:22.945763+0000","last_fullsized":"2024-01-19T05:01:22.945763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'70","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.167337+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T05:00:40.167337+0000","last_peered":"2024-01-19T05:00:40.167337+0000","last_clean":"2024-01-19T05:00:40.167337+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T05:00:40.167337+0000","last_undegraded":"2024-01-19T05:00:40.167337+0000","last_fullsized":"2024-01-19T05:00:40.167337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'19","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.992189+0000","last_change":"2024-01-19T04:32:36.019089+0000","last_active":"2024-01-19T05:01:41.992189+0000","last_peered":"2024-01-19T05:01:41.992189+0000","last_clean":"2024-01-19T05:01:41.992189+0000","last_became_active":"2024-01-19T04:32:36.018566+0000","last_became_peered":"2024-01-19T04:32:36.018566+0000","last_unstale":"2024-01-19T05:01:41.992189+0000","last_undegraded":"2024-01-19T05:01:41.992189+0000","last_fullsized":"2024-01-19T05:01:41.992189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:22.492389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:11.372976+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T05:01:11.372976+0000","last_peered":"2024-01-19T05:01:11.372976+0000","last_clean":"2024-01-19T05:01:11.372976+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T05:01:11.372976+0000","last_undegraded":"2024-01-19T05:01:11.372976+0000","last_fullsized":"2024-01-19T05:01:11.372976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'99","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.987631+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T05:00:39.987631+0000","last_peered":"2024-01-19T05:00:39.987631+0000","last_clean":"2024-01-19T05:00:39.987631+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T05:00:39.987631+0000","last_undegraded":"2024-01-19T05:00:39.987631+0000","last_fullsized":"2024-01-19T05:00:39.987631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'21","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.690377+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T05:01:41.690377+0000","last_peered":"2024-01-19T05:01:41.690377+0000","last_clean":"2024-01-19T05:01:41.690377+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T05:01:41.690377+0000","last_undegraded":"2024-01-19T05:01:41.690377+0000","last_fullsized":"2024-01-19T05:01:41.690377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.002220+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T05:01:01.002220+0000","last_peered":"2024-01-19T05:01:01.002220+0000","last_clean":"2024-01-19T05:01:01.002220+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T05:01:01.002220+0000","last_undegraded":"2024-01-19T05:01:01.002220+0000","last_fullsized":"2024-01-19T05:01:01.002220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'56","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.735552+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T05:00:37.735552+0000","last_peered":"2024-01-19T05:00:37.735552+0000","last_clean":"2024-01-19T05:00:37.735552+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T05:00:37.735552+0000","last_undegraded":"2024-01-19T05:00:37.735552+0000","last_fullsized":"2024-01-19T05:00:37.735552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'25","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669567+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T05:01:41.669567+0000","last_peered":"2024-01-19T05:01:41.669567+0000","last_clean":"2024-01-19T05:01:41.669567+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T05:01:41.669567+0000","last_undegraded":"2024-01-19T05:01:41.669567+0000","last_fullsized":"2024-01-19T05:01:41.669567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'571","reported_seq":1167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:36.783094+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T05:01:36.783094+0000","last_peered":"2024-01-19T05:01:36.783094+0000","last_clean":"2024-01-19T05:01:36.783094+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T05:01:36.783094+0000","last_undegraded":"2024-01-19T05:01:36.783094+0000","last_fullsized":"2024-01-19T05:01:36.783094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129245,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":569,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'65","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.340064+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T05:00:39.340064+0000","last_peered":"2024-01-19T05:00:39.340064+0000","last_clean":"2024-01-19T05:00:39.340064+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T05:00:39.340064+0000","last_undegraded":"2024-01-19T05:00:39.340064+0000","last_fullsized":"2024-01-19T05:00:39.340064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":6769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879997+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T05:01:41.879997+0000","last_peered":"2024-01-19T05:01:41.879997+0000","last_clean":"2024-01-19T05:01:41.879997+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T05:01:41.879997+0000","last_undegraded":"2024-01-19T05:01:41.879997+0000","last_fullsized":"2024-01-19T05:01:41.879997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.385654+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T05:01:31.385654+0000","last_peered":"2024-01-19T05:01:31.385654+0000","last_clean":"2024-01-19T05:01:31.385654+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T05:01:31.385654+0000","last_undegraded":"2024-01-19T05:01:31.385654+0000","last_fullsized":"2024-01-19T05:01:31.385654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'104","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.025716+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T05:00:39.025716+0000","last_peered":"2024-01-19T05:00:39.025716+0000","last_clean":"2024-01-19T05:00:39.025716+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T05:00:39.025716+0000","last_undegraded":"2024-01-19T05:00:39.025716+0000","last_fullsized":"2024-01-19T05:00:39.025716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":11574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878545+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T05:01:41.878545+0000","last_peered":"2024-01-19T05:01:41.878545+0000","last_clean":"2024-01-19T05:01:41.878545+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T05:01:41.878545+0000","last_undegraded":"2024-01-19T05:01:41.878545+0000","last_fullsized":"2024-01-19T05:01:41.878545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:51.495665+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T05:00:51.495665+0000","last_peered":"2024-01-19T05:00:51.495665+0000","last_clean":"2024-01-19T05:00:51.495665+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T05:00:51.495665+0000","last_undegraded":"2024-01-19T05:00:51.495665+0000","last_fullsized":"2024-01-19T05:00:51.495665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T04:58:56.813272+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:58:56.813272+0000","last_peered":"2024-01-19T04:58:56.813272+0000","last_clean":"2024-01-19T04:58:56.813272+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:58:56.813272+0000","last_undegraded":"2024-01-19T04:58:56.813272+0000","last_fullsized":"2024-01-19T04:58:56.813272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.104947+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T05:00:40.104947+0000","last_peered":"2024-01-19T05:00:40.104947+0000","last_clean":"2024-01-19T05:00:40.104947+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T05:00:40.104947+0000","last_undegraded":"2024-01-19T05:00:40.104947+0000","last_fullsized":"2024-01-19T05:00:40.104947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815761+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T05:01:41.815761+0000","last_peered":"2024-01-19T05:01:41.815761+0000","last_clean":"2024-01-19T05:01:41.815761+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T05:01:41.815761+0000","last_undegraded":"2024-01-19T05:01:41.815761+0000","last_fullsized":"2024-01-19T05:01:41.815761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'12","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:17.722407+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T05:01:17.722407+0000","last_peered":"2024-01-19T05:01:17.722407+0000","last_clean":"2024-01-19T05:01:17.722407+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T05:01:17.722407+0000","last_undegraded":"2024-01-19T05:01:17.722407+0000","last_fullsized":"2024-01-19T05:01:17.722407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'80","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:22.079775+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T05:00:22.079775+0000","last_peered":"2024-01-19T05:00:22.079775+0000","last_clean":"2024-01-19T05:00:22.079775+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T05:00:22.079775+0000","last_undegraded":"2024-01-19T05:00:22.079775+0000","last_fullsized":"2024-01-19T05:00:22.079775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'22","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.705546+0000","last_change":"2024-01-19T04:32:36.982936+0000","last_active":"2024-01-19T05:01:41.705546+0000","last_peered":"2024-01-19T05:01:41.705546+0000","last_clean":"2024-01-19T05:01:41.705546+0000","last_became_active":"2024-01-19T04:32:36.982330+0000","last_became_peered":"2024-01-19T04:32:36.982330+0000","last_unstale":"2024-01-19T05:01:41.705546+0000","last_undegraded":"2024-01-19T05:01:41.705546+0000","last_fullsized":"2024-01-19T05:01:41.705546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:39.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:07.272964+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T05:01:07.272964+0000","last_peered":"2024-01-19T05:01:07.272964+0000","last_clean":"2024-01-19T05:01:07.272964+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T05:01:07.272964+0000","last_undegraded":"2024-01-19T05:01:07.272964+0000","last_fullsized":"2024-01-19T05:01:07.272964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'75","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.202314+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T05:00:39.202314+0000","last_peered":"2024-01-19T05:00:39.202314+0000","last_clean":"2024-01-19T05:00:39.202314+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T05:00:39.202314+0000","last_undegraded":"2024-01-19T05:00:39.202314+0000","last_fullsized":"2024-01-19T05:00:39.202314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":9598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.819246+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T05:01:41.819246+0000","last_peered":"2024-01-19T05:01:41.819246+0000","last_clean":"2024-01-19T05:01:41.819246+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T05:01:41.819246+0000","last_undegraded":"2024-01-19T05:01:41.819246+0000","last_fullsized":"2024-01-19T05:01:41.819246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:26.074425+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T05:01:26.074425+0000","last_peered":"2024-01-19T05:01:26.074425+0000","last_clean":"2024-01-19T05:01:26.074425+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T05:01:26.074425+0000","last_undegraded":"2024-01-19T05:01:26.074425+0000","last_fullsized":"2024-01-19T05:01:26.074425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.016220+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T05:00:29.016220+0000","last_peered":"2024-01-19T05:00:29.016220+0000","last_clean":"2024-01-19T05:00:29.016220+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T05:00:29.016220+0000","last_undegraded":"2024-01-19T05:00:29.016220+0000","last_fullsized":"2024-01-19T05:00:29.016220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":7505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.801564+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T05:01:41.801564+0000","last_peered":"2024-01-19T05:01:41.801564+0000","last_clean":"2024-01-19T05:01:41.801564+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T05:01:41.801564+0000","last_undegraded":"2024-01-19T05:01:41.801564+0000","last_fullsized":"2024-01-19T05:01:41.801564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.025179+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T05:01:01.025179+0000","last_peered":"2024-01-19T05:01:01.025179+0000","last_clean":"2024-01-19T05:01:01.025179+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T05:01:01.025179+0000","last_undegraded":"2024-01-19T05:01:01.025179+0000","last_fullsized":"2024-01-19T05:01:01.025179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'111","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.227926+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T05:00:39.227926+0000","last_peered":"2024-01-19T05:00:39.227926+0000","last_clean":"2024-01-19T05:00:39.227926+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T05:00:39.227926+0000","last_undegraded":"2024-01-19T05:00:39.227926+0000","last_fullsized":"2024-01-19T05:00:39.227926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.782334+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T05:01:41.782334+0000","last_peered":"2024-01-19T05:01:41.782334+0000","last_clean":"2024-01-19T05:01:41.782334+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T05:01:41.782334+0000","last_undegraded":"2024-01-19T05:01:41.782334+0000","last_fullsized":"2024-01-19T05:01:41.782334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:17.722126+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T05:01:17.722126+0000","last_peered":"2024-01-19T05:01:17.722126+0000","last_clean":"2024-01-19T05:01:17.722126+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T05:01:17.722126+0000","last_undegraded":"2024-01-19T05:01:17.722126+0000","last_fullsized":"2024-01-19T05:01:17.722126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'79","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.455331+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T05:00:39.455331+0000","last_peered":"2024-01-19T05:00:39.455331+0000","last_clean":"2024-01-19T05:00:39.455331+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T05:00:39.455331+0000","last_undegraded":"2024-01-19T05:00:39.455331+0000","last_fullsized":"2024-01-19T05:00:39.455331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895659+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T05:01:41.895659+0000","last_peered":"2024-01-19T05:01:41.895659+0000","last_clean":"2024-01-19T05:01:41.895659+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T05:01:41.895659+0000","last_undegraded":"2024-01-19T05:01:41.895659+0000","last_fullsized":"2024-01-19T05:01:41.895659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.315399+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T05:01:31.315399+0000","last_peered":"2024-01-19T05:01:31.315399+0000","last_clean":"2024-01-19T05:01:31.315399+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T05:01:31.315399+0000","last_undegraded":"2024-01-19T05:01:31.315399+0000","last_fullsized":"2024-01-19T05:01:31.315399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'73","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456178+0000","last_change":"2024-01-19T04:32:37.173262+0000","last_active":"2024-01-19T05:00:39.456178+0000","last_peered":"2024-01-19T05:00:39.456178+0000","last_clean":"2024-01-19T05:00:39.456178+0000","last_became_active":"2024-01-19T04:32:37.172443+0000","last_became_peered":"2024-01-19T04:32:37.172443+0000","last_unstale":"2024-01-19T05:00:39.456178+0000","last_undegraded":"2024-01-19T05:00:39.456178+0000","last_fullsized":"2024-01-19T05:00:39.456178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:47.286856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.821645+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T05:01:41.821645+0000","last_peered":"2024-01-19T05:01:41.821645+0000","last_clean":"2024-01-19T05:01:41.821645+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T05:01:41.821645+0000","last_undegraded":"2024-01-19T05:01:41.821645+0000","last_fullsized":"2024-01-19T05:01:41.821645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'12","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:32.401009+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T05:01:32.401009+0000","last_peered":"2024-01-19T05:01:32.401009+0000","last_clean":"2024-01-19T05:01:32.401009+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T05:01:32.401009+0000","last_undegraded":"2024-01-19T05:01:32.401009+0000","last_fullsized":"2024-01-19T05:01:32.401009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.991388+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T05:00:39.991388+0000","last_peered":"2024-01-19T05:00:39.991388+0000","last_clean":"2024-01-19T05:00:39.991388+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T05:00:39.991388+0000","last_undegraded":"2024-01-19T05:00:39.991388+0000","last_fullsized":"2024-01-19T05:00:39.991388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'26","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895870+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T05:01:41.895870+0000","last_peered":"2024-01-19T05:01:41.895870+0000","last_clean":"2024-01-19T05:01:41.895870+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T05:01:41.895870+0000","last_undegraded":"2024-01-19T05:01:41.895870+0000","last_fullsized":"2024-01-19T05:01:41.895870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.004300+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T05:01:01.004300+0000","last_peered":"2024-01-19T05:01:01.004300+0000","last_clean":"2024-01-19T05:01:01.004300+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T05:01:01.004300+0000","last_undegraded":"2024-01-19T05:01:01.004300+0000","last_fullsized":"2024-01-19T05:01:01.004300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'85","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.190851+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T05:00:39.190851+0000","last_peered":"2024-01-19T05:00:39.190851+0000","last_clean":"2024-01-19T05:00:39.190851+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T05:00:39.190851+0000","last_undegraded":"2024-01-19T05:00:39.190851+0000","last_fullsized":"2024-01-19T05:00:39.190851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.781396+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T05:01:41.781396+0000","last_peered":"2024-01-19T05:01:41.781396+0000","last_clean":"2024-01-19T05:01:41.781396+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T05:01:41.781396+0000","last_undegraded":"2024-01-19T05:01:41.781396+0000","last_fullsized":"2024-01-19T05:01:41.781396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'830","reported_seq":864,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:23.910166+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T05:01:23.910166+0000","last_peered":"2024-01-19T05:01:23.910166+0000","last_clean":"2024-01-19T05:01:23.910166+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T05:01:23.910166+0000","last_undegraded":"2024-01-19T05:01:23.910166+0000","last_fullsized":"2024-01-19T05:01:23.910166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":4574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.907056+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T05:00:36.907056+0000","last_peered":"2024-01-19T05:00:36.907056+0000","last_clean":"2024-01-19T05:00:36.907056+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T05:00:36.907056+0000","last_undegraded":"2024-01-19T05:00:36.907056+0000","last_fullsized":"2024-01-19T05:00:36.907056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'25","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706189+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T05:01:41.706189+0000","last_peered":"2024-01-19T05:01:41.706189+0000","last_clean":"2024-01-19T05:01:41.706189+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T05:01:41.706189+0000","last_undegraded":"2024-01-19T05:01:41.706189+0000","last_fullsized":"2024-01-19T05:01:41.706189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'388","reported_seq":421,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:34.288447+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T05:01:34.288447+0000","last_peered":"2024-01-19T05:01:34.288447+0000","last_clean":"2024-01-19T05:01:34.288447+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T05:01:34.288447+0000","last_undegraded":"2024-01-19T05:01:34.288447+0000","last_fullsized":"2024-01-19T05:01:34.288447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'136","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.453507+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T05:00:39.453507+0000","last_peered":"2024-01-19T05:00:39.453507+0000","last_clean":"2024-01-19T05:00:39.453507+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T05:00:39.453507+0000","last_undegraded":"2024-01-19T05:00:39.453507+0000","last_fullsized":"2024-01-19T05:00:39.453507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891164+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T05:01:41.891164+0000","last_peered":"2024-01-19T05:01:41.891164+0000","last_clean":"2024-01-19T05:01:41.891164+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T05:01:41.891164+0000","last_undegraded":"2024-01-19T05:01:41.891164+0000","last_fullsized":"2024-01-19T05:01:41.891164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:02.941137+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T05:01:02.941137+0000","last_peered":"2024-01-19T05:01:02.941137+0000","last_clean":"2024-01-19T05:01:02.941137+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T05:01:02.941137+0000","last_undegraded":"2024-01-19T05:01:02.941137+0000","last_fullsized":"2024-01-19T05:01:02.941137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:26.451904+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T05:00:26.451904+0000","last_peered":"2024-01-19T05:00:26.451904+0000","last_clean":"2024-01-19T05:00:26.451904+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T05:00:26.451904+0000","last_undegraded":"2024-01-19T05:00:26.451904+0000","last_fullsized":"2024-01-19T05:00:26.451904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.810961+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T05:01:41.810961+0000","last_peered":"2024-01-19T05:01:41.810961+0000","last_clean":"2024-01-19T05:01:41.810961+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T05:01:41.810961+0000","last_undegraded":"2024-01-19T05:01:41.810961+0000","last_fullsized":"2024-01-19T05:01:41.810961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'17","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.378730+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T05:01:41.378730+0000","last_peered":"2024-01-19T05:01:41.378730+0000","last_clean":"2024-01-19T05:01:41.378730+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T05:01:41.378730+0000","last_undegraded":"2024-01-19T05:01:41.378730+0000","last_fullsized":"2024-01-19T05:01:41.378730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'83","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:16.414257+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T05:00:16.414257+0000","last_peered":"2024-01-19T05:00:16.414257+0000","last_clean":"2024-01-19T05:00:16.414257+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T05:00:16.414257+0000","last_undegraded":"2024-01-19T05:00:16.414257+0000","last_fullsized":"2024-01-19T05:00:16.414257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'74","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.035231+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T05:00:29.035231+0000","last_peered":"2024-01-19T05:00:29.035231+0000","last_clean":"2024-01-19T05:00:29.035231+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T05:00:29.035231+0000","last_undegraded":"2024-01-19T05:00:29.035231+0000","last_fullsized":"2024-01-19T05:00:29.035231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.672750+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T05:01:41.672750+0000","last_peered":"2024-01-19T05:01:41.672750+0000","last_clean":"2024-01-19T05:01:41.672750+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T05:01:41.672750+0000","last_undegraded":"2024-01-19T05:01:41.672750+0000","last_fullsized":"2024-01-19T05:01:41.672750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.300615+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T05:01:31.300615+0000","last_peered":"2024-01-19T05:01:31.300615+0000","last_clean":"2024-01-19T05:01:31.300615+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T05:01:31.300615+0000","last_undegraded":"2024-01-19T05:01:31.300615+0000","last_fullsized":"2024-01-19T05:01:31.300615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.056917+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T05:00:40.056917+0000","last_peered":"2024-01-19T05:00:40.056917+0000","last_clean":"2024-01-19T05:00:40.056917+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T05:00:40.056917+0000","last_undegraded":"2024-01-19T05:00:40.056917+0000","last_fullsized":"2024-01-19T05:00:40.056917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":13922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892111+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T05:01:41.892111+0000","last_peered":"2024-01-19T05:01:41.892111+0000","last_clean":"2024-01-19T05:01:41.892111+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T05:01:41.892111+0000","last_undegraded":"2024-01-19T05:01:41.892111+0000","last_fullsized":"2024-01-19T05:01:41.892111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'4","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.109280+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T05:00:39.109280+0000","last_peered":"2024-01-19T05:00:39.109280+0000","last_clean":"2024-01-19T05:00:39.109280+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T05:00:39.109280+0000","last_undegraded":"2024-01-19T05:00:39.109280+0000","last_fullsized":"2024-01-19T05:00:39.109280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'646","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:16.645553+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T05:01:16.645553+0000","last_peered":"2024-01-19T05:01:16.645553+0000","last_clean":"2024-01-19T05:01:16.645553+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T05:01:16.645553+0000","last_undegraded":"2024-01-19T05:01:16.645553+0000","last_fullsized":"2024-01-19T05:01:16.645553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'25","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.898703+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T05:01:41.898703+0000","last_peered":"2024-01-19T05:01:41.898703+0000","last_clean":"2024-01-19T05:01:41.898703+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T05:01:41.898703+0000","last_undegraded":"2024-01-19T05:01:41.898703+0000","last_fullsized":"2024-01-19T05:01:41.898703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'47","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.204764+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T05:00:39.204764+0000","last_peered":"2024-01-19T05:00:39.204764+0000","last_clean":"2024-01-19T05:00:39.204764+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T05:00:39.204764+0000","last_undegraded":"2024-01-19T05:00:39.204764+0000","last_fullsized":"2024-01-19T05:00:39.204764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'584","reported_seq":617,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:33.977903+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T05:01:33.977903+0000","last_peered":"2024-01-19T05:01:33.977903+0000","last_clean":"2024-01-19T05:01:33.977903+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T05:01:33.977903+0000","last_undegraded":"2024-01-19T05:01:33.977903+0000","last_fullsized":"2024-01-19T05:01:33.977903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.697325+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T05:01:41.697325+0000","last_peered":"2024-01-19T05:01:41.697325+0000","last_clean":"2024-01-19T05:01:41.697325+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T05:01:41.697325+0000","last_undegraded":"2024-01-19T05:01:41.697325+0000","last_fullsized":"2024-01-19T05:01:41.697325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400511+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T05:00:39.400511+0000","last_peered":"2024-01-19T05:00:39.400511+0000","last_clean":"2024-01-19T05:00:39.400511+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T05:00:39.400511+0000","last_undegraded":"2024-01-19T05:00:39.400511+0000","last_fullsized":"2024-01-19T05:00:39.400511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983016+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T05:01:41.983016+0000","last_peered":"2024-01-19T05:01:41.983016+0000","last_clean":"2024-01-19T05:01:41.983016+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T05:01:41.983016+0000","last_undegraded":"2024-01-19T05:01:41.983016+0000","last_fullsized":"2024-01-19T05:01:41.983016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'30","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.998230+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T05:01:41.998230+0000","last_peered":"2024-01-19T05:01:41.998230+0000","last_clean":"2024-01-19T05:01:41.998230+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T05:01:41.998230+0000","last_undegraded":"2024-01-19T05:01:41.998230+0000","last_fullsized":"2024-01-19T05:01:41.998230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'28","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.693715+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T05:01:41.693715+0000","last_peered":"2024-01-19T05:01:41.693715+0000","last_clean":"2024-01-19T05:01:41.693715+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T05:01:41.693715+0000","last_undegraded":"2024-01-19T05:01:41.693715+0000","last_fullsized":"2024-01-19T05:01:41.693715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.897403+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T05:01:41.897403+0000","last_peered":"2024-01-19T05:01:41.897403+0000","last_clean":"2024-01-19T05:01:41.897403+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T05:01:41.897403+0000","last_undegraded":"2024-01-19T05:01:41.897403+0000","last_fullsized":"2024-01-19T05:01:41.897403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'17","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878880+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T05:01:41.878880+0000","last_peered":"2024-01-19T05:01:41.878880+0000","last_clean":"2024-01-19T05:01:41.878880+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T05:01:41.878880+0000","last_undegraded":"2024-01-19T05:01:41.878880+0000","last_fullsized":"2024-01-19T05:01:41.878880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'22","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.670021+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T05:01:41.670021+0000","last_peered":"2024-01-19T05:01:41.670021+0000","last_clean":"2024-01-19T05:01:41.670021+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T05:01:41.670021+0000","last_undegraded":"2024-01-19T05:01:41.670021+0000","last_fullsized":"2024-01-19T05:01:41.670021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'34","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.984301+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T05:01:41.984301+0000","last_peered":"2024-01-19T05:01:41.984301+0000","last_clean":"2024-01-19T05:01:41.984301+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T05:01:41.984301+0000","last_undegraded":"2024-01-19T05:01:41.984301+0000","last_fullsized":"2024-01-19T05:01:41.984301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.871897+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T05:01:41.871897+0000","last_peered":"2024-01-19T05:01:41.871897+0000","last_clean":"2024-01-19T05:01:41.871897+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T05:01:41.871897+0000","last_undegraded":"2024-01-19T05:01:41.871897+0000","last_fullsized":"2024-01-19T05:01:41.871897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.708579+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T05:01:41.708579+0000","last_peered":"2024-01-19T05:01:41.708579+0000","last_clean":"2024-01-19T05:01:41.708579+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T05:01:41.708579+0000","last_undegraded":"2024-01-19T05:01:41.708579+0000","last_fullsized":"2024-01-19T05:01:41.708579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879130+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T05:01:41.879130+0000","last_peered":"2024-01-19T05:01:41.879130+0000","last_clean":"2024-01-19T05:01:41.879130+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T05:01:41.879130+0000","last_undegraded":"2024-01-19T05:01:41.879130+0000","last_fullsized":"2024-01-19T05:01:41.879130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'27","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.811706+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T05:01:41.811706+0000","last_peered":"2024-01-19T05:01:41.811706+0000","last_clean":"2024-01-19T05:01:41.811706+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T05:01:41.811706+0000","last_undegraded":"2024-01-19T05:01:41.811706+0000","last_fullsized":"2024-01-19T05:01:41.811706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'31","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.898426+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T05:01:41.898426+0000","last_peered":"2024-01-19T05:01:41.898426+0000","last_clean":"2024-01-19T05:01:41.898426+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T05:01:41.898426+0000","last_undegraded":"2024-01-19T05:01:41.898426+0000","last_fullsized":"2024-01-19T05:01:41.898426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983450+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T05:01:41.983450+0000","last_peered":"2024-01-19T05:01:41.983450+0000","last_clean":"2024-01-19T05:01:41.983450+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T05:01:41.983450+0000","last_undegraded":"2024-01-19T05:01:41.983450+0000","last_fullsized":"2024-01-19T05:01:41.983450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706377+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T05:01:41.706377+0000","last_peered":"2024-01-19T05:01:41.706377+0000","last_clean":"2024-01-19T05:01:41.706377+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T05:01:41.706377+0000","last_undegraded":"2024-01-19T05:01:41.706377+0000","last_fullsized":"2024-01-19T05:01:41.706377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'31","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.996824+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T05:01:41.996824+0000","last_peered":"2024-01-19T05:01:41.996824+0000","last_clean":"2024-01-19T05:01:41.996824+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T05:01:41.996824+0000","last_undegraded":"2024-01-19T05:01:41.996824+0000","last_fullsized":"2024-01-19T05:01:41.996824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'27","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.993057+0000","last_change":"2024-01-19T04:32:37.020144+0000","last_active":"2024-01-19T05:01:41.993057+0000","last_peered":"2024-01-19T05:01:41.993057+0000","last_clean":"2024-01-19T05:01:41.993057+0000","last_became_active":"2024-01-19T04:32:37.019820+0000","last_became_peered":"2024-01-19T04:32:37.019820+0000","last_unstale":"2024-01-19T05:01:41.993057+0000","last_undegraded":"2024-01-19T05:01:41.993057+0000","last_fullsized":"2024-01-19T05:01:41.993057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:48.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'30","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.769347+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T05:01:41.769347+0000","last_peered":"2024-01-19T05:01:41.769347+0000","last_clean":"2024-01-19T05:01:41.769347+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T05:01:41.769347+0000","last_undegraded":"2024-01-19T05:01:41.769347+0000","last_fullsized":"2024-01-19T05:01:41.769347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'23","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669301+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T05:01:41.669301+0000","last_peered":"2024-01-19T05:01:41.669301+0000","last_clean":"2024-01-19T05:01:41.669301+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T05:01:41.669301+0000","last_undegraded":"2024-01-19T05:01:41.669301+0000","last_fullsized":"2024-01-19T05:01:41.669301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'25","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895367+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T05:01:41.895367+0000","last_peered":"2024-01-19T05:01:41.895367+0000","last_clean":"2024-01-19T05:01:41.895367+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T05:01:41.895367+0000","last_undegraded":"2024-01-19T05:01:41.895367+0000","last_fullsized":"2024-01-19T05:01:41.895367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'29","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.889958+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T05:01:41.889958+0000","last_peered":"2024-01-19T05:01:41.889958+0000","last_clean":"2024-01-19T05:01:41.889958+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T05:01:41.889958+0000","last_undegraded":"2024-01-19T05:01:41.889958+0000","last_fullsized":"2024-01-19T05:01:41.889958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704394+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T05:01:41.704394+0000","last_peered":"2024-01-19T05:01:41.704394+0000","last_clean":"2024-01-19T05:01:41.704394+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T05:01:41.704394+0000","last_undegraded":"2024-01-19T05:01:41.704394+0000","last_fullsized":"2024-01-19T05:01:41.704394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.980207+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T05:01:41.980207+0000","last_peered":"2024-01-19T05:01:41.980207+0000","last_clean":"2024-01-19T05:01:41.980207+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T05:01:41.980207+0000","last_undegraded":"2024-01-19T05:01:41.980207+0000","last_fullsized":"2024-01-19T05:01:41.980207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.986160+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T05:01:41.986160+0000","last_peered":"2024-01-19T05:01:41.986160+0000","last_clean":"2024-01-19T05:01:41.986160+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T05:01:41.986160+0000","last_undegraded":"2024-01-19T05:01:41.986160+0000","last_fullsized":"2024-01-19T05:01:41.986160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815246+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T05:01:41.815246+0000","last_peered":"2024-01-19T05:01:41.815246+0000","last_clean":"2024-01-19T05:01:41.815246+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T05:01:41.815246+0000","last_undegraded":"2024-01-19T05:01:41.815246+0000","last_fullsized":"2024-01-19T05:01:41.815246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'19","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892314+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T05:01:41.892314+0000","last_peered":"2024-01-19T05:01:41.892314+0000","last_clean":"2024-01-19T05:01:41.892314+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T05:01:41.892314+0000","last_undegraded":"2024-01-19T05:01:41.892314+0000","last_fullsized":"2024-01-19T05:01:41.892314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'21","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.679032+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T05:01:41.679032+0000","last_peered":"2024-01-19T05:01:41.679032+0000","last_clean":"2024-01-19T05:01:41.679032+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T05:01:41.679032+0000","last_undegraded":"2024-01-19T05:01:41.679032+0000","last_fullsized":"2024-01-19T05:01:41.679032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.746534+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T05:01:41.746534+0000","last_peered":"2024-01-19T05:01:41.746534+0000","last_clean":"2024-01-19T05:01:41.746534+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T05:01:41.746534+0000","last_undegraded":"2024-01-19T05:01:41.746534+0000","last_fullsized":"2024-01-19T05:01:41.746534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'24","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.668376+0000","last_change":"2024-01-19T04:32:36.986632+0000","last_active":"2024-01-19T05:01:41.668376+0000","last_peered":"2024-01-19T05:01:41.668376+0000","last_clean":"2024-01-19T05:01:41.668376+0000","last_became_active":"2024-01-19T04:32:36.986250+0000","last_became_peered":"2024-01-19T04:32:36.986250+0000","last_unstale":"2024-01-19T05:01:41.668376+0000","last_undegraded":"2024-01-19T05:01:41.668376+0000","last_fullsized":"2024-01-19T05:01:41.668376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:25:48.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.817181+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T05:01:41.817181+0000","last_peered":"2024-01-19T05:01:41.817181+0000","last_clean":"2024-01-19T05:01:41.817181+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T05:01:41.817181+0000","last_undegraded":"2024-01-19T05:01:41.817181+0000","last_fullsized":"2024-01-19T05:01:41.817181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'26","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880081+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T05:01:41.880081+0000","last_peered":"2024-01-19T05:01:41.880081+0000","last_clean":"2024-01-19T05:01:41.880081+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T05:01:41.880081+0000","last_undegraded":"2024-01-19T05:01:41.880081+0000","last_fullsized":"2024-01-19T05:01:41.880081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.660484+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T05:01:41.660484+0000","last_peered":"2024-01-19T05:01:41.660484+0000","last_clean":"2024-01-19T05:01:41.660484+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T05:01:41.660484+0000","last_undegraded":"2024-01-19T05:01:41.660484+0000","last_fullsized":"2024-01-19T05:01:41.660484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'24","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704922+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T05:01:41.704922+0000","last_peered":"2024-01-19T05:01:41.704922+0000","last_clean":"2024-01-19T05:01:41.704922+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T05:01:41.704922+0000","last_undegraded":"2024-01-19T05:01:41.704922+0000","last_fullsized":"2024-01-19T05:01:41.704922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2422,"num_write_kb":254160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2601,"ondisk_log_size":2601,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1580,"ondisk_log_size":1580,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24103801,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":5649,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48455680,"data_stored":48207602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5167,"ondisk_log_size":5167,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477112,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":495616,"data_stored":270316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.26100000000000001},"max":{"1min":1.2509999999999999,"5min":1.3160000000000001,"15min":2.2389999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.76200000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.29699999999999999},"max":{"1min":1.4099999999999999,"5min":1.4339999999999999,"15min":1.6739999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.309},"max":{"1min":1.264,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.875,"15min":0.81899999999999995},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.32200000000000001},"max":{"1min":1.202,"5min":1.754,"15min":1.754},"last":0.748}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.77300000000000002},"min":{"1min":0.45400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2709999999999999,"5min":2.52,"15min":2.52},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93799999999999994,"15min":0.90500000000000003},"min":{"1min":0.437,"5min":0.373,"15min":0.31900000000000001},"max":{"1min":1.321,"5min":1.5,"15min":2.0670000000000002},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0740000000000001,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":1.667,"15min":1.9590000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0820000000000001,"15min":1.0509999999999999},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.49,"5min":1.867,"15min":1.867},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1040000000000001,"15min":1.081},"min":{"1min":0.73399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.452,"5min":1.954,"15min":1.954},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":2.625,"15min":2.625},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.0880000000000001,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1599999999999999,"15min":1.1439999999999999},"min":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.57799999999999996},"max":{"1min":1.736,"5min":1.736,"15min":2.129},"last":1.155}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.151},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":1.913,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1890000000000001,"15min":1.119},"min":{"1min":0.84899999999999998,"5min":0.74399999999999999,"15min":0.60499999999999998},"max":{"1min":1.444,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.88100000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477113,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":140672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.4490000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.675},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.29399999999999998},"max":{"1min":1.22,"5min":1.244,"15min":1.4930000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.86199999999999999,"15min":0.84499999999999997},"min":{"1min":0.59299999999999997,"5min":0.40000000000000002,"15min":0.29499999999999998},"max":{"1min":1.466,"5min":1.468,"15min":1.486},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.68400000000000005,"5min":0.443,"15min":0.31900000000000001},"max":{"1min":1.1639999999999999,"5min":1.3140000000000001,"15min":1.6200000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.875,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.605,"15min":1.605},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.65700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3400000000000001,"5min":1.47,"15min":1.7689999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1160000000000001,"15min":1.1020000000000001},"min":{"1min":0.81200000000000006,"5min":0.69399999999999995,"15min":0.63300000000000001},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.9590000000000001},"last":1.258}]},{"osd":5,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0920000000000001},"min":{"1min":0.871,"5min":0.63300000000000001,"15min":0.60399999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.83699999999999997,"5min":0.56299999999999994,"15min":0.45500000000000002},"max":{"1min":1.5329999999999999,"5min":1.5469999999999999,"15min":1.72},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.133,"15min":1.1359999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0030000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.1850000000000001},"min":{"1min":0.94999999999999996,"5min":0.76700000000000002,"15min":0.61299999999999999},"max":{"1min":1.744,"5min":1.9139999999999999,"15min":2.0150000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.89200000000000002,"5min":0.73599999999999999,"15min":0.69099999999999995},"max":{"1min":1.921,"5min":1.921,"15min":2.2650000000000001},"last":1.1830000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509816,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":8744960,"data_stored":8529791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.46700000000000003,"15min":0.41799999999999998},"max":{"1min":1.2909999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.872,"15min":0.88200000000000001},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.4370000000000001,"15min":1.712},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96799999999999997,"15min":0.95499999999999996},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.2290000000000001,"5min":1.4359999999999999,"15min":1.5269999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94399999999999995,"15min":0.92300000000000004},"min":{"1min":0.59999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.3999999999999999},"last":1.048}]},{"osd":2,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.48799999999999999,"15min":0.46700000000000003},"max":{"1min":1.2490000000000001,"5min":1.462,"15min":1.5740000000000001},"last":0.747},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.96399999999999997},"min":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.55600000000000005},"max":{"1min":1.238,"5min":1.3400000000000001,"15min":1.4059999999999999},"last":0.88100000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.625,"5min":0.54500000000000004,"15min":0.46100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.4850000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.05,"15min":1.0409999999999999},"min":{"1min":0.75,"5min":0.60099999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.552,"15min":1.6180000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.68100000000000005,"5min":0.61899999999999999,"15min":0.58899999999999997},"max":{"1min":1.29,"5min":1.3360000000000001,"15min":1.8169999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0600000000000001,"15min":1.0660000000000001},"min":{"1min":0.59799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.472,"5min":1.486,"15min":1.7589999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.752,"5min":0.64300000000000002,"15min":0.45700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.657},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1140000000000001,"15min":1.1319999999999999},"min":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3839999999999999,"5min":1.46,"15min":1.698},"last":1.012}]},{"osd":7,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.145,"15min":1.141},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.3660000000000001,"5min":1.605,"15min":1.728},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1459999999999999,"15min":1.1379999999999999},"min":{"1min":0.90700000000000003,"5min":0.84999999999999998,"15min":0.68700000000000006},"max":{"1min":1.49,"5min":1.512,"15min":1.7769999999999999},"last":1.1080000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509816,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":143653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.84799999999999998,"15min":0.81499999999999995},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.433},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":3.2200000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95699999999999996,"15min":0.92400000000000004},"min":{"1min":0.63600000000000001,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.861}]},{"osd":1,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7729999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.91200000000000003},"min":{"1min":0.69699999999999995,"5min":0.55300000000000005,"15min":0.40300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.9730000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":0.98699999999999999},"min":{"1min":0.61699999999999999,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.9379999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.97199999999999998,"15min":0.94499999999999995},"min":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.51100000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":2.1760000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.0600000000000001},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.47399999999999998},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":2.6040000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0669999999999999,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.58899999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":2.0950000000000002}]},{"osd":4,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.90800000000000003,"15min":0.89400000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47899999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":2.7450000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.65000000000000002,"15min":0.51900000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":2.3999999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.028,"15min":1.0449999999999999},"min":{"1min":0.68600000000000005,"5min":0.58299999999999996,"15min":0.44900000000000001},"max":{"1min":1.3839999999999999,"5min":1.466,"15min":1.468},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.008,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.33200000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":2.8199999999999998}]},{"osd":7,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1839999999999999,"15min":1.171},"min":{"1min":1.016,"5min":0.79700000000000004,"15min":0.42399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":2.5139999999999998},{"interface":"front","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.64500000000000002,"15min":0.57999999999999996},"max":{"1min":1.5389999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.80800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":8744960,"data_stored":8529659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88100000000000001,"15min":0.88500000000000001},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1990000000000001,"5min":1.3109999999999999,"15min":2.04},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3089999999999999,"5min":1.4399999999999999,"15min":2.1970000000000001},"last":1.032},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.51500000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.6309999999999998},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.51300000000000001},"max":{"1min":1.3879999999999999,"5min":1.6279999999999999,"15min":2.7810000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64000000000000001,"5min":0.55100000000000005,"15min":0.504},"max":{"1min":1.5640000000000001,"5min":1.7,"15min":1.7},"last":1.1279999999999999}]},{"osd":3,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.008,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":2.4820000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.069,"15min":1.083},"min":{"1min":0.84399999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.339,"5min":1.5369999999999999,"15min":2.4399999999999999},"last":1.2829999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.46000000000000002},"max":{"1min":1.484,"5min":1.5149999999999999,"15min":1.9119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.034,"15min":1.054},"min":{"1min":0.70799999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":2.7160000000000002},"last":1.077}]},{"osd":6,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.115,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.474,"5min":1.502,"15min":2.3650000000000002},"last":1.355},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.095,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7549999999999999},"last":1.25}]},{"osd":7,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1080000000000001,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.601,"5min":1.601,"15min":3.1720000000000002},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.49,"5min":1.718,"15min":2.8999999999999999},"last":1.169}]}]},{"osd":3,"up_from":15,"seq":64424509816,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":11600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":11878400,"data_stored":11653269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.33600000000000002},"max":{"1min":1.0009999999999999,"5min":1.47,"15min":1.47},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.71699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.30599999999999999},"max":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.3109999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.33400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3069999999999999,"15min":1.4339999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85199999999999998,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.42499999999999999,"15min":0.36199999999999999},"max":{"1min":1.153,"5min":1.444,"15min":1.444},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.47599999999999998,"15min":0.376},"max":{"1min":1.397,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.88500000000000001},"min":{"1min":0.51300000000000001,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4870000000000001,"5min":1.5369999999999999,"15min":1.5680000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.5049999999999999,"15min":1.5580000000000001},"last":0.879},{"interface":"front","average":{"1min":1.071,"5min":1.103,"15min":1.075},"min":{"1min":0.78100000000000003,"5min":0.65100000000000002,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.0920000000000001},"min":{"1min":0.68700000000000006,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.728,"15min":1.728},"last":1.081},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.0580000000000001},"min":{"1min":0.74399999999999999,"5min":0.621,"15min":0.60299999999999998},"max":{"1min":1.6459999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0940000000000001,"15min":1.0649999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.56200000000000006},"max":{"1min":1.3939999999999999,"5min":1.569,"15min":1.734},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.165},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.004}]},{"osd":7,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1180000000000001},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.60999999999999999},"max":{"1min":1.5700000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.163,"15min":1.1240000000000001},"min":{"1min":0.93200000000000005,"5min":0.78300000000000003,"15min":0.69999999999999996},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.8340000000000001},"last":1.036}]}]},{"osd":7,"up_from":14,"seq":60129542520,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48564,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323276,"statfs":{"total":96636764160,"available":96587034624,"internally_reserved":0,"allocated":13545472,"data_stored":13315101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.372},"max":{"1min":1.212,"5min":1.577,"15min":1.577},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.65500000000000003,"5min":0.51100000000000001,"15min":0.47699999999999998},"max":{"1min":1.2150000000000001,"5min":1.294,"15min":1.4430000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.65300000000000002,"5min":0.55900000000000005,"15min":0.48899999999999999},"max":{"1min":1.22,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.94499999999999995,"15min":0.92000000000000004},"min":{"1min":0.73499999999999999,"5min":0.55100000000000005,"15min":0.48399999999999999},"max":{"1min":1.2889999999999999,"5min":1.3560000000000001,"15min":1.7549999999999999},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0069999999999999,"15min":0.999},"min":{"1min":0.67900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.325,"5min":1.4390000000000001,"15min":1.6319999999999999},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.04,"15min":1.0169999999999999},"min":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3240000000000001,"5min":1.5009999999999999,"15min":1.542},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.70899999999999996,"5min":0.51100000000000001,"15min":0.46500000000000002},"max":{"1min":1.1679999999999999,"5min":1.758,"15min":1.758},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40799999999999997},"max":{"1min":1.395,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.099},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0249999999999999,"15min":1.0549999999999999},"min":{"1min":0.70799999999999996,"5min":0.53500000000000003,"15min":0.40600000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6339999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0580000000000001,"15min":1.0549999999999999},"min":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.622},"max":{"1min":1.367,"5min":1.51,"15min":1.9259999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.087,"15min":1.093},"min":{"1min":0.626,"5min":0.61099999999999999,"15min":0.432},"max":{"1min":1.298,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.1359999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.45600000000000002},"max":{"1min":1.4550000000000001,"5min":1.4710000000000001,"15min":1.8480000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.67600000000000005},"max":{"1min":1.4219999999999999,"5min":1.5680000000000001,"15min":1.75},"last":1.284}]}]},{"osd":0,"up_from":14,"seq":60129542520,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34972,"kb_used_data":7956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336868,"statfs":{"total":96636764160,"available":96600952832,"internally_reserved":0,"allocated":8146944,"data_stored":7918997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69199999999999995,"15min":0.68300000000000005},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.29099999999999998},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":2.1629999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.42299999999999999,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.78100000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.317},"max":{"1min":1.216,"5min":1.861,"15min":1.861},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":1.3500000000000001,"5min":1.4770000000000001,"15min":2.2490000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.248},"max":{"1min":1.3140000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":1.7050000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.2130000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0249999999999999,"15min":1.0029999999999999},"min":{"1min":0.72199999999999998,"5min":0.56299999999999994,"15min":0.502},"max":{"1min":1.901,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0660000000000001,"15min":1.0589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.3330000000000002},"last":1.161}]},{"osd":5,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1040000000000001,"15min":1.109},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.46800000000000003},"max":{"1min":1.514,"5min":1.909,"15min":1.909},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.651,"5min":2.0840000000000001,"15min":2.1150000000000002},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1499999999999999,"15min":1.1299999999999999},"min":{"1min":0.73999999999999999,"5min":0.66600000000000004,"15min":0.61299999999999999},"max":{"1min":1.998,"5min":1.998,"15min":2.4500000000000002},"last":1.274},{"interface":"front","average":{"1min":1.202,"5min":1.1659999999999999,"15min":1.155},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.60799999999999998},"max":{"1min":1.591,"5min":1.831,"15min":1.964},"last":1.302}]},{"osd":7,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1970000000000001,"15min":1.1839999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.61399999999999999},"max":{"1min":1.589,"5min":1.968,"15min":1.968},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.845,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":7189489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":131176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11546624,"data_stored":11514129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:01:48.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:01:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b90e04640 1 Processor -- start 2024-01-19T05:01:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b90e04640 1 -- start start 2024-01-19T05:01:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b90e04640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1519e0 0x7f4b8c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b90e04640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c158390 con 0x7f4b8c06f350 2024-01-19T05:01:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b90e04640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c15b0e0 con 0x7f4b8c151600 2024-01-19T05:01:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b90e04640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c157b70 con 0x7f4b8c1519e0 2024-01-19T05:01:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b8ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4b8c06f350 0x7f4b8c0cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45304/0 (socket says 172.21.15.133:45304) 2024-01-19T05:01:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b8ad9d640 1 -- 172.21.15.133:0/3126735201 learned_addr learned my addr 172.21.15.133:0/3126735201 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.674+0000 7f4b89d9b640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1519e0 0x7f4b8c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.678+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763561404 0 0) 0x7f4b8c158390 con 0x7f4b8c06f350 2024-01-19T05:01:48.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.678+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b74003530 con 0x7f4b8c06f350 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2558090899 0 0) 0x7f4b74003530 con 0x7f4b8c06f350 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1519e0 msgr2=0x7f4b8c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1519e0 0x7f4b8c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 >> v1:172.21.15.156:6789/0 conn(0x7f4b8c151600 legacy=0x7f4b8c157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c157dd0 con 0x7f4b8c06f350 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f4b84001a00 con 0x7f4b8c06f350 2024-01-19T05:01:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 >> v1:172.21.15.133:6789/0 conn(0x7f4b8c06f350 legacy=0x7f4b8c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b740039b0 0x7f4b74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b740047d0 0x7f4b74004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b74005150 0x7f4b7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c157b70 con 0x7f4b740039b0 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400bed0 con 0x7f4b74005150 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400c010 con 0x7f4b740047d0 2024-01-19T05:01:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.682+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b740039b0 0x7f4b74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.686+0000 7f4b8a59c640 1 -- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b740047d0 msgr2=0x7f4b74004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.686+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b740047d0 0x7f4b74004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.686+0000 7f4b8a59c640 1 -- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b74005150 msgr2=0x7f4b7400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.686+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b74005150 0x7f4b7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.686+0000 7f4b8a59c640 1 -- 172.21.15.133:0/3126735201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74003530 con 0x7f4b740039b0 2024-01-19T05:01:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.690+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b740039b0 0x7f4b74003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c001780 tx=0x7f4b7c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a076ddfbb5f68efc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0052d0 con 0x7f4b740039b0 2024-01-19T05:01:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0a7050 con 0x7f4b740039b0 2024-01-19T05:01:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b8959a640 1 -- 172.21.15.133:0/3126735201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c003840 con 0x7f4b740039b0 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b90e04640 1 -- 172.21.15.133:0/3126735201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b740039b0 msgr2=0x7f4b74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3126735201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b740039b0 0x7f4b74003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c001780 tx=0x7f4b7c01c370 comp rx=0 tx=0).stop 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b8ad9d640 1 -- 172.21.15.133:0/3126735201 reap_dead start 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b90e04640 1 -- 172.21.15.133:0/3126735201 shutdown_connections 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b90e04640 1 -- 172.21.15.133:0/3126735201 >> 172.21.15.133:0/3126735201 conn(0x7f4b8c06d590 msgr2=0x7f4b8c066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b90e04640 1 -- 172.21.15.133:0/3126735201 shutdown_connections 2024-01-19T05:01:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.694+0000 7f4b90e04640 1 -- 172.21.15.133:0/3126735201 wait complete. 2024-01-19T05:01:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 Processor -- start 2024-01-19T05:01:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 -- start start 2024-01-19T05:01:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b740039b0 0x7f4b8c161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 0x7f4b8c0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1474d0 0x7f4b8c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0c0230 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0c6190 con 0x7f4b740039b0 2024-01-19T05:01:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b90e04640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c0c95e0 con 0x7f4b8c1474d0 2024-01-19T05:01:48.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b89d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 0x7f4b8c0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b89d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 0x7f4b8c0c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33730/0 (socket says 172.21.15.133:33730) 2024-01-19T05:01:48.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b89d9b640 1 -- 172.21.15.133:0/3084914058 learned_addr learned my addr 172.21.15.133:0/3084914058 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b8ad9d640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1474d0 0x7f4b8c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.698+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b740039b0 0x7f4b8c161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.702+0000 7f4b89d9b640 1 -- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1474d0 msgr2=0x7f4b8c147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.702+0000 7f4b89d9b640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1474d0 0x7f4b8c147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.702+0000 7f4b89d9b640 1 -- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b740039b0 msgr2=0x7f4b8c161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.702+0000 7f4b89d9b640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b740039b0 0x7f4b8c161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.702+0000 7f4b89d9b640 1 -- 172.21.15.133:0/3084914058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0c63e0 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.706+0000 7f4b89d9b640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 0x7f4b8c0c90a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e7f0 tx=0x7f4b8000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.710+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000c940 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.710+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000caa0 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.710+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000ce50 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.710+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c0c66c0 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.710+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c0ca1f0 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.710+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c071fa0 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.994+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4b80013470 con 0x7f4b8c0c8c60 2024-01-19T05:01:48.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.994+0000 7f4b7affd640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4b6c066530 0x7f4b6c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:48.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.994+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4b6c066530 0x7f4b6c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:48.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:48.994+0000 7f4b8a59c640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4b6c066530 0x7f4b6c0689f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c001750 tx=0x7f4b7c0011a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:49.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.018+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b80055580 con 0x7f4b8c0c8c60 2024-01-19T05:01:49.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.018+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4b800518c0 con 0x7f4b8c0c8c60 2024-01-19T05:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.190+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b8c0c7a70 con 0x7f4b6c066530 2024-01-19T05:01:49.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.218+0000 7f4b7affd640 1 -- 172.21.15.133:0/3084914058 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369475 (secure 0 0 0) 0x7f4b7c0a4e90 con 0x7f4b6c066530 2024-01-19T05:01:49.219 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:01:49.223 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4b6c066530 msgr2=0x7f4b6c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4b6c066530 0x7f4b6c0689f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c001750 tx=0x7f4b7c0011a0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 msgr2=0x7f4b8c0c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 0x7f4b8c0c90a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e7f0 tx=0x7f4b8000ecb0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 shutdown_connections 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4b6c066530 0x7f4b6c0689f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b8c1474d0 0x7f4b8c147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b8c0c8c60 0x7f4b8c0c90a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 --2- 172.21.15.133:0/3084914058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b740039b0 0x7f4b8c161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 >> 172.21.15.133:0/3084914058 conn(0x7f4b8c06d590 msgr2=0x7f4b8c070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:49.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 shutdown_connections 2024-01-19T05:01:49.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.222+0000 7f4b90e04640 1 -- 172.21.15.133:0/3084914058 wait complete. 2024-01-19T05:01:49.242 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":958,"stamp":"2024-01-19T05:01:48.414209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24694169,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":677,"num_read_kb":685,"num_write":8230,"num_write_kb":283324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9465,"ondisk_log_size":9465,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326848,"kb_used_data":51072,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754647872,"statfs":{"total":773094113280,"available":772759420928,"internally_reserved":0,"allocated":52297728,"data_stored":50501458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":282316336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10660,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005489"},"pg_stats":[{"pgid":"2.1f","version":"31'645","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:05.126879+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T05:01:05.126879+0000","last_peered":"2024-01-19T05:01:05.126879+0000","last_clean":"2024-01-19T05:01:05.126879+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T05:01:05.126879+0000","last_undegraded":"2024-01-19T05:01:05.126879+0000","last_fullsized":"2024-01-19T05:01:05.126879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.885215+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T05:01:41.885215+0000","last_peered":"2024-01-19T05:01:41.885215+0000","last_clean":"2024-01-19T05:01:41.885215+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T05:01:41.885215+0000","last_undegraded":"2024-01-19T05:01:41.885215+0000","last_fullsized":"2024-01-19T05:01:41.885215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456294+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T05:00:39.456294+0000","last_peered":"2024-01-19T05:00:39.456294+0000","last_clean":"2024-01-19T05:00:39.456294+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T05:00:39.456294+0000","last_undegraded":"2024-01-19T05:00:39.456294+0000","last_fullsized":"2024-01-19T05:00:39.456294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'262","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:42.127587+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T05:01:42.127587+0000","last_peered":"2024-01-19T05:01:42.127587+0000","last_clean":"2024-01-19T05:01:42.127587+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T05:01:42.127587+0000","last_undegraded":"2024-01-19T05:01:42.127587+0000","last_fullsized":"2024-01-19T05:01:42.127587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2994311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891716+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T05:01:41.891716+0000","last_peered":"2024-01-19T05:01:41.891716+0000","last_clean":"2024-01-19T05:01:41.891716+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T05:01:41.891716+0000","last_undegraded":"2024-01-19T05:01:41.891716+0000","last_fullsized":"2024-01-19T05:01:41.891716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'79","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.912319+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T05:00:36.912319+0000","last_peered":"2024-01-19T05:00:36.912319+0000","last_clean":"2024-01-19T05:00:36.912319+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T05:00:36.912319+0000","last_undegraded":"2024-01-19T05:00:36.912319+0000","last_fullsized":"2024-01-19T05:00:36.912319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.961414+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T05:01:21.961414+0000","last_peered":"2024-01-19T05:01:21.961414+0000","last_clean":"2024-01-19T05:01:21.961414+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T05:01:21.961414+0000","last_undegraded":"2024-01-19T05:01:21.961414+0000","last_fullsized":"2024-01-19T05:01:21.961414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'21","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.818570+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T05:01:41.818570+0000","last_peered":"2024-01-19T05:01:41.818570+0000","last_clean":"2024-01-19T05:01:41.818570+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T05:01:41.818570+0000","last_undegraded":"2024-01-19T05:01:41.818570+0000","last_fullsized":"2024-01-19T05:01:41.818570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'86","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400126+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T05:00:39.400126+0000","last_peered":"2024-01-19T05:00:39.400126+0000","last_clean":"2024-01-19T05:00:39.400126+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T05:00:39.400126+0000","last_undegraded":"2024-01-19T05:00:39.400126+0000","last_fullsized":"2024-01-19T05:00:39.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.159984+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T05:01:27.159984+0000","last_peered":"2024-01-19T05:01:27.159984+0000","last_clean":"2024-01-19T05:01:27.159984+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T05:01:27.159984+0000","last_undegraded":"2024-01-19T05:01:27.159984+0000","last_fullsized":"2024-01-19T05:01:27.159984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.808509+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T05:01:41.808509+0000","last_peered":"2024-01-19T05:01:41.808509+0000","last_clean":"2024-01-19T05:01:41.808509+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T05:01:41.808509+0000","last_undegraded":"2024-01-19T05:01:41.808509+0000","last_fullsized":"2024-01-19T05:01:41.808509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'85","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.439380+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T05:00:37.439380+0000","last_peered":"2024-01-19T05:00:37.439380+0000","last_clean":"2024-01-19T05:00:37.439380+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T05:00:37.439380+0000","last_undegraded":"2024-01-19T05:00:37.439380+0000","last_fullsized":"2024-01-19T05:00:37.439380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983091+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T05:01:41.983091+0000","last_peered":"2024-01-19T05:01:41.983091+0000","last_clean":"2024-01-19T05:01:41.983091+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T05:01:41.983091+0000","last_undegraded":"2024-01-19T05:01:41.983091+0000","last_fullsized":"2024-01-19T05:01:41.983091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'676","reported_seq":711,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:25.018447+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T05:01:25.018447+0000","last_peered":"2024-01-19T05:01:25.018447+0000","last_clean":"2024-01-19T05:01:25.018447+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T05:01:25.018447+0000","last_undegraded":"2024-01-19T05:01:25.018447+0000","last_fullsized":"2024-01-19T05:01:25.018447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'66","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:35.377800+0000","last_change":"2024-01-19T04:32:37.510574+0000","last_active":"2024-01-19T05:00:35.377800+0000","last_peered":"2024-01-19T05:00:35.377800+0000","last_clean":"2024-01-19T05:00:35.377800+0000","last_became_active":"2024-01-19T04:32:37.509981+0000","last_became_peered":"2024-01-19T04:32:37.509981+0000","last_unstale":"2024-01-19T05:00:35.377800+0000","last_undegraded":"2024-01-19T05:00:35.377800+0000","last_fullsized":"2024-01-19T05:00:35.377800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:57:44.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895522+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T05:01:41.895522+0000","last_peered":"2024-01-19T05:01:41.895522+0000","last_clean":"2024-01-19T05:01:41.895522+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T05:01:41.895522+0000","last_undegraded":"2024-01-19T05:01:41.895522+0000","last_fullsized":"2024-01-19T05:01:41.895522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:57.737776+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T05:00:57.737776+0000","last_peered":"2024-01-19T05:00:57.737776+0000","last_clean":"2024-01-19T05:00:57.737776+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T05:00:57.737776+0000","last_undegraded":"2024-01-19T05:00:57.737776+0000","last_fullsized":"2024-01-19T05:00:57.737776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'75","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.777943+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T05:00:36.777943+0000","last_peered":"2024-01-19T05:00:36.777943+0000","last_clean":"2024-01-19T05:00:36.777943+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T05:00:36.777943+0000","last_undegraded":"2024-01-19T05:00:36.777943+0000","last_fullsized":"2024-01-19T05:00:36.777943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.888619+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T05:01:41.888619+0000","last_peered":"2024-01-19T05:01:41.888619+0000","last_clean":"2024-01-19T05:01:41.888619+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T05:01:41.888619+0000","last_undegraded":"2024-01-19T05:01:41.888619+0000","last_fullsized":"2024-01-19T05:01:41.888619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:54.689539+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T05:00:54.689539+0000","last_peered":"2024-01-19T05:00:54.689539+0000","last_clean":"2024-01-19T05:00:54.689539+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T05:00:54.689539+0000","last_undegraded":"2024-01-19T05:00:54.689539+0000","last_fullsized":"2024-01-19T05:00:54.689539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'84","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.128938+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T05:00:39.128938+0000","last_peered":"2024-01-19T05:00:39.128938+0000","last_clean":"2024-01-19T05:00:39.128938+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T05:00:39.128938+0000","last_undegraded":"2024-01-19T05:00:39.128938+0000","last_fullsized":"2024-01-19T05:00:39.128938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.129743+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T05:00:40.129743+0000","last_peered":"2024-01-19T05:00:40.129743+0000","last_clean":"2024-01-19T05:00:40.129743+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T05:00:40.129743+0000","last_undegraded":"2024-01-19T05:00:40.129743+0000","last_fullsized":"2024-01-19T05:00:40.129743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.960586+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T05:01:21.960586+0000","last_peered":"2024-01-19T05:01:21.960586+0000","last_clean":"2024-01-19T05:01:21.960586+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T05:01:21.960586+0000","last_undegraded":"2024-01-19T05:01:21.960586+0000","last_fullsized":"2024-01-19T05:01:21.960586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'64","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.178229+0000","last_change":"2024-01-19T04:32:37.173175+0000","last_active":"2024-01-19T05:00:40.178229+0000","last_peered":"2024-01-19T05:00:40.178229+0000","last_clean":"2024-01-19T05:00:40.178229+0000","last_became_active":"2024-01-19T04:32:37.172049+0000","last_became_peered":"2024-01-19T04:32:37.172049+0000","last_unstale":"2024-01-19T05:00:40.178229+0000","last_undegraded":"2024-01-19T05:00:40.178229+0000","last_fullsized":"2024-01-19T05:00:40.178229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:44:06.445358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880902+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T05:01:41.880902+0000","last_peered":"2024-01-19T05:01:41.880902+0000","last_clean":"2024-01-19T05:01:41.880902+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T05:01:41.880902+0000","last_undegraded":"2024-01-19T05:01:41.880902+0000","last_fullsized":"2024-01-19T05:01:41.880902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.160162+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T05:01:27.160162+0000","last_peered":"2024-01-19T05:01:27.160162+0000","last_clean":"2024-01-19T05:01:27.160162+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T05:01:27.160162+0000","last_undegraded":"2024-01-19T05:01:27.160162+0000","last_fullsized":"2024-01-19T05:01:27.160162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'70","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.078499+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T05:00:39.078499+0000","last_peered":"2024-01-19T05:00:39.078499+0000","last_clean":"2024-01-19T05:00:39.078499+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T05:00:39.078499+0000","last_undegraded":"2024-01-19T05:00:39.078499+0000","last_fullsized":"2024-01-19T05:00:39.078499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.883471+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T05:01:41.883471+0000","last_peered":"2024-01-19T05:01:41.883471+0000","last_clean":"2024-01-19T05:01:41.883471+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T05:01:41.883471+0000","last_undegraded":"2024-01-19T05:01:41.883471+0000","last_fullsized":"2024-01-19T05:01:41.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'338","reported_seq":372,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:35.559737+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T05:01:35.559737+0000","last_peered":"2024-01-19T05:01:35.559737+0000","last_clean":"2024-01-19T05:01:35.559737+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T05:01:35.559737+0000","last_undegraded":"2024-01-19T05:01:35.559737+0000","last_fullsized":"2024-01-19T05:01:35.559737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":914,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.935298+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T05:00:39.935298+0000","last_peered":"2024-01-19T05:00:39.935298+0000","last_clean":"2024-01-19T05:00:39.935298+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T05:00:39.935298+0000","last_undegraded":"2024-01-19T05:00:39.935298+0000","last_fullsized":"2024-01-19T05:00:39.935298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669743+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T05:01:41.669743+0000","last_peered":"2024-01-19T05:01:41.669743+0000","last_clean":"2024-01-19T05:01:41.669743+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T05:01:41.669743+0000","last_undegraded":"2024-01-19T05:01:41.669743+0000","last_fullsized":"2024-01-19T05:01:41.669743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'7","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:22.945763+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T05:01:22.945763+0000","last_peered":"2024-01-19T05:01:22.945763+0000","last_clean":"2024-01-19T05:01:22.945763+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T05:01:22.945763+0000","last_undegraded":"2024-01-19T05:01:22.945763+0000","last_fullsized":"2024-01-19T05:01:22.945763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'70","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.167337+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T05:00:40.167337+0000","last_peered":"2024-01-19T05:00:40.167337+0000","last_clean":"2024-01-19T05:00:40.167337+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T05:00:40.167337+0000","last_undegraded":"2024-01-19T05:00:40.167337+0000","last_fullsized":"2024-01-19T05:00:40.167337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'19","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.992189+0000","last_change":"2024-01-19T04:32:36.019089+0000","last_active":"2024-01-19T05:01:41.992189+0000","last_peered":"2024-01-19T05:01:41.992189+0000","last_clean":"2024-01-19T05:01:41.992189+0000","last_became_active":"2024-01-19T04:32:36.018566+0000","last_became_peered":"2024-01-19T04:32:36.018566+0000","last_unstale":"2024-01-19T05:01:41.992189+0000","last_undegraded":"2024-01-19T05:01:41.992189+0000","last_fullsized":"2024-01-19T05:01:41.992189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:22.492389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:11.372976+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T05:01:11.372976+0000","last_peered":"2024-01-19T05:01:11.372976+0000","last_clean":"2024-01-19T05:01:11.372976+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T05:01:11.372976+0000","last_undegraded":"2024-01-19T05:01:11.372976+0000","last_fullsized":"2024-01-19T05:01:11.372976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'99","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.987631+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T05:00:39.987631+0000","last_peered":"2024-01-19T05:00:39.987631+0000","last_clean":"2024-01-19T05:00:39.987631+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T05:00:39.987631+0000","last_undegraded":"2024-01-19T05:00:39.987631+0000","last_fullsized":"2024-01-19T05:00:39.987631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'21","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.690377+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T05:01:41.690377+0000","last_peered":"2024-01-19T05:01:41.690377+0000","last_clean":"2024-01-19T05:01:41.690377+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T05:01:41.690377+0000","last_undegraded":"2024-01-19T05:01:41.690377+0000","last_fullsized":"2024-01-19T05:01:41.690377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.002220+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T05:01:01.002220+0000","last_peered":"2024-01-19T05:01:01.002220+0000","last_clean":"2024-01-19T05:01:01.002220+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T05:01:01.002220+0000","last_undegraded":"2024-01-19T05:01:01.002220+0000","last_fullsized":"2024-01-19T05:01:01.002220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'56","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.735552+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T05:00:37.735552+0000","last_peered":"2024-01-19T05:00:37.735552+0000","last_clean":"2024-01-19T05:00:37.735552+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T05:00:37.735552+0000","last_undegraded":"2024-01-19T05:00:37.735552+0000","last_fullsized":"2024-01-19T05:00:37.735552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'25","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669567+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T05:01:41.669567+0000","last_peered":"2024-01-19T05:01:41.669567+0000","last_clean":"2024-01-19T05:01:41.669567+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T05:01:41.669567+0000","last_undegraded":"2024-01-19T05:01:41.669567+0000","last_fullsized":"2024-01-19T05:01:41.669567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'571","reported_seq":1167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:36.783094+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T05:01:36.783094+0000","last_peered":"2024-01-19T05:01:36.783094+0000","last_clean":"2024-01-19T05:01:36.783094+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T05:01:36.783094+0000","last_undegraded":"2024-01-19T05:01:36.783094+0000","last_fullsized":"2024-01-19T05:01:36.783094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129245,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":569,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'65","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.340064+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T05:00:39.340064+0000","last_peered":"2024-01-19T05:00:39.340064+0000","last_clean":"2024-01-19T05:00:39.340064+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T05:00:39.340064+0000","last_undegraded":"2024-01-19T05:00:39.340064+0000","last_fullsized":"2024-01-19T05:00:39.340064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":6769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879997+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T05:01:41.879997+0000","last_peered":"2024-01-19T05:01:41.879997+0000","last_clean":"2024-01-19T05:01:41.879997+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T05:01:41.879997+0000","last_undegraded":"2024-01-19T05:01:41.879997+0000","last_fullsized":"2024-01-19T05:01:41.879997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.385654+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T05:01:31.385654+0000","last_peered":"2024-01-19T05:01:31.385654+0000","last_clean":"2024-01-19T05:01:31.385654+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T05:01:31.385654+0000","last_undegraded":"2024-01-19T05:01:31.385654+0000","last_fullsized":"2024-01-19T05:01:31.385654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'104","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.025716+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T05:00:39.025716+0000","last_peered":"2024-01-19T05:00:39.025716+0000","last_clean":"2024-01-19T05:00:39.025716+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T05:00:39.025716+0000","last_undegraded":"2024-01-19T05:00:39.025716+0000","last_fullsized":"2024-01-19T05:00:39.025716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":11574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878545+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T05:01:41.878545+0000","last_peered":"2024-01-19T05:01:41.878545+0000","last_clean":"2024-01-19T05:01:41.878545+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T05:01:41.878545+0000","last_undegraded":"2024-01-19T05:01:41.878545+0000","last_fullsized":"2024-01-19T05:01:41.878545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:51.495665+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T05:00:51.495665+0000","last_peered":"2024-01-19T05:00:51.495665+0000","last_clean":"2024-01-19T05:00:51.495665+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T05:00:51.495665+0000","last_undegraded":"2024-01-19T05:00:51.495665+0000","last_fullsized":"2024-01-19T05:00:51.495665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T04:58:56.813272+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:58:56.813272+0000","last_peered":"2024-01-19T04:58:56.813272+0000","last_clean":"2024-01-19T04:58:56.813272+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:58:56.813272+0000","last_undegraded":"2024-01-19T04:58:56.813272+0000","last_fullsized":"2024-01-19T04:58:56.813272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.104947+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T05:00:40.104947+0000","last_peered":"2024-01-19T05:00:40.104947+0000","last_clean":"2024-01-19T05:00:40.104947+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T05:00:40.104947+0000","last_undegraded":"2024-01-19T05:00:40.104947+0000","last_fullsized":"2024-01-19T05:00:40.104947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815761+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T05:01:41.815761+0000","last_peered":"2024-01-19T05:01:41.815761+0000","last_clean":"2024-01-19T05:01:41.815761+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T05:01:41.815761+0000","last_undegraded":"2024-01-19T05:01:41.815761+0000","last_fullsized":"2024-01-19T05:01:41.815761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'12","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:17.722407+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T05:01:17.722407+0000","last_peered":"2024-01-19T05:01:17.722407+0000","last_clean":"2024-01-19T05:01:17.722407+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T05:01:17.722407+0000","last_undegraded":"2024-01-19T05:01:17.722407+0000","last_fullsized":"2024-01-19T05:01:17.722407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'80","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:22.079775+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T05:00:22.079775+0000","last_peered":"2024-01-19T05:00:22.079775+0000","last_clean":"2024-01-19T05:00:22.079775+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T05:00:22.079775+0000","last_undegraded":"2024-01-19T05:00:22.079775+0000","last_fullsized":"2024-01-19T05:00:22.079775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'22","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.705546+0000","last_change":"2024-01-19T04:32:36.982936+0000","last_active":"2024-01-19T05:01:41.705546+0000","last_peered":"2024-01-19T05:01:41.705546+0000","last_clean":"2024-01-19T05:01:41.705546+0000","last_became_active":"2024-01-19T04:32:36.982330+0000","last_became_peered":"2024-01-19T04:32:36.982330+0000","last_unstale":"2024-01-19T05:01:41.705546+0000","last_undegraded":"2024-01-19T05:01:41.705546+0000","last_fullsized":"2024-01-19T05:01:41.705546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:39.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:07.272964+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T05:01:07.272964+0000","last_peered":"2024-01-19T05:01:07.272964+0000","last_clean":"2024-01-19T05:01:07.272964+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T05:01:07.272964+0000","last_undegraded":"2024-01-19T05:01:07.272964+0000","last_fullsized":"2024-01-19T05:01:07.272964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'75","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.202314+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T05:00:39.202314+0000","last_peered":"2024-01-19T05:00:39.202314+0000","last_clean":"2024-01-19T05:00:39.202314+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T05:00:39.202314+0000","last_undegraded":"2024-01-19T05:00:39.202314+0000","last_fullsized":"2024-01-19T05:00:39.202314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":9598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.819246+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T05:01:41.819246+0000","last_peered":"2024-01-19T05:01:41.819246+0000","last_clean":"2024-01-19T05:01:41.819246+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T05:01:41.819246+0000","last_undegraded":"2024-01-19T05:01:41.819246+0000","last_fullsized":"2024-01-19T05:01:41.819246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:26.074425+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T05:01:26.074425+0000","last_peered":"2024-01-19T05:01:26.074425+0000","last_clean":"2024-01-19T05:01:26.074425+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T05:01:26.074425+0000","last_undegraded":"2024-01-19T05:01:26.074425+0000","last_fullsized":"2024-01-19T05:01:26.074425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.016220+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T05:00:29.016220+0000","last_peered":"2024-01-19T05:00:29.016220+0000","last_clean":"2024-01-19T05:00:29.016220+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T05:00:29.016220+0000","last_undegraded":"2024-01-19T05:00:29.016220+0000","last_fullsized":"2024-01-19T05:00:29.016220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":7505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.801564+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T05:01:41.801564+0000","last_peered":"2024-01-19T05:01:41.801564+0000","last_clean":"2024-01-19T05:01:41.801564+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T05:01:41.801564+0000","last_undegraded":"2024-01-19T05:01:41.801564+0000","last_fullsized":"2024-01-19T05:01:41.801564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.025179+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T05:01:01.025179+0000","last_peered":"2024-01-19T05:01:01.025179+0000","last_clean":"2024-01-19T05:01:01.025179+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T05:01:01.025179+0000","last_undegraded":"2024-01-19T05:01:01.025179+0000","last_fullsized":"2024-01-19T05:01:01.025179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'111","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.227926+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T05:00:39.227926+0000","last_peered":"2024-01-19T05:00:39.227926+0000","last_clean":"2024-01-19T05:00:39.227926+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T05:00:39.227926+0000","last_undegraded":"2024-01-19T05:00:39.227926+0000","last_fullsized":"2024-01-19T05:00:39.227926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.782334+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T05:01:41.782334+0000","last_peered":"2024-01-19T05:01:41.782334+0000","last_clean":"2024-01-19T05:01:41.782334+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T05:01:41.782334+0000","last_undegraded":"2024-01-19T05:01:41.782334+0000","last_fullsized":"2024-01-19T05:01:41.782334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:17.722126+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T05:01:17.722126+0000","last_peered":"2024-01-19T05:01:17.722126+0000","last_clean":"2024-01-19T05:01:17.722126+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T05:01:17.722126+0000","last_undegraded":"2024-01-19T05:01:17.722126+0000","last_fullsized":"2024-01-19T05:01:17.722126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'79","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.455331+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T05:00:39.455331+0000","last_peered":"2024-01-19T05:00:39.455331+0000","last_clean":"2024-01-19T05:00:39.455331+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T05:00:39.455331+0000","last_undegraded":"2024-01-19T05:00:39.455331+0000","last_fullsized":"2024-01-19T05:00:39.455331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895659+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T05:01:41.895659+0000","last_peered":"2024-01-19T05:01:41.895659+0000","last_clean":"2024-01-19T05:01:41.895659+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T05:01:41.895659+0000","last_undegraded":"2024-01-19T05:01:41.895659+0000","last_fullsized":"2024-01-19T05:01:41.895659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.315399+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T05:01:31.315399+0000","last_peered":"2024-01-19T05:01:31.315399+0000","last_clean":"2024-01-19T05:01:31.315399+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T05:01:31.315399+0000","last_undegraded":"2024-01-19T05:01:31.315399+0000","last_fullsized":"2024-01-19T05:01:31.315399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'73","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456178+0000","last_change":"2024-01-19T04:32:37.173262+0000","last_active":"2024-01-19T05:00:39.456178+0000","last_peered":"2024-01-19T05:00:39.456178+0000","last_clean":"2024-01-19T05:00:39.456178+0000","last_became_active":"2024-01-19T04:32:37.172443+0000","last_became_peered":"2024-01-19T04:32:37.172443+0000","last_unstale":"2024-01-19T05:00:39.456178+0000","last_undegraded":"2024-01-19T05:00:39.456178+0000","last_fullsized":"2024-01-19T05:00:39.456178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:47.286856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.821645+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T05:01:41.821645+0000","last_peered":"2024-01-19T05:01:41.821645+0000","last_clean":"2024-01-19T05:01:41.821645+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T05:01:41.821645+0000","last_undegraded":"2024-01-19T05:01:41.821645+0000","last_fullsized":"2024-01-19T05:01:41.821645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'12","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:32.401009+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T05:01:32.401009+0000","last_peered":"2024-01-19T05:01:32.401009+0000","last_clean":"2024-01-19T05:01:32.401009+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T05:01:32.401009+0000","last_undegraded":"2024-01-19T05:01:32.401009+0000","last_fullsized":"2024-01-19T05:01:32.401009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.991388+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T05:00:39.991388+0000","last_peered":"2024-01-19T05:00:39.991388+0000","last_clean":"2024-01-19T05:00:39.991388+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T05:00:39.991388+0000","last_undegraded":"2024-01-19T05:00:39.991388+0000","last_fullsized":"2024-01-19T05:00:39.991388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'26","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895870+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T05:01:41.895870+0000","last_peered":"2024-01-19T05:01:41.895870+0000","last_clean":"2024-01-19T05:01:41.895870+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T05:01:41.895870+0000","last_undegraded":"2024-01-19T05:01:41.895870+0000","last_fullsized":"2024-01-19T05:01:41.895870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.004300+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T05:01:01.004300+0000","last_peered":"2024-01-19T05:01:01.004300+0000","last_clean":"2024-01-19T05:01:01.004300+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T05:01:01.004300+0000","last_undegraded":"2024-01-19T05:01:01.004300+0000","last_fullsized":"2024-01-19T05:01:01.004300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'85","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.190851+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T05:00:39.190851+0000","last_peered":"2024-01-19T05:00:39.190851+0000","last_clean":"2024-01-19T05:00:39.190851+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T05:00:39.190851+0000","last_undegraded":"2024-01-19T05:00:39.190851+0000","last_fullsized":"2024-01-19T05:00:39.190851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.781396+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T05:01:41.781396+0000","last_peered":"2024-01-19T05:01:41.781396+0000","last_clean":"2024-01-19T05:01:41.781396+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T05:01:41.781396+0000","last_undegraded":"2024-01-19T05:01:41.781396+0000","last_fullsized":"2024-01-19T05:01:41.781396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'830","reported_seq":864,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:23.910166+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T05:01:23.910166+0000","last_peered":"2024-01-19T05:01:23.910166+0000","last_clean":"2024-01-19T05:01:23.910166+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T05:01:23.910166+0000","last_undegraded":"2024-01-19T05:01:23.910166+0000","last_fullsized":"2024-01-19T05:01:23.910166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":4574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.907056+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T05:00:36.907056+0000","last_peered":"2024-01-19T05:00:36.907056+0000","last_clean":"2024-01-19T05:00:36.907056+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T05:00:36.907056+0000","last_undegraded":"2024-01-19T05:00:36.907056+0000","last_fullsized":"2024-01-19T05:00:36.907056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'25","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706189+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T05:01:41.706189+0000","last_peered":"2024-01-19T05:01:41.706189+0000","last_clean":"2024-01-19T05:01:41.706189+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T05:01:41.706189+0000","last_undegraded":"2024-01-19T05:01:41.706189+0000","last_fullsized":"2024-01-19T05:01:41.706189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'388","reported_seq":421,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:34.288447+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T05:01:34.288447+0000","last_peered":"2024-01-19T05:01:34.288447+0000","last_clean":"2024-01-19T05:01:34.288447+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T05:01:34.288447+0000","last_undegraded":"2024-01-19T05:01:34.288447+0000","last_fullsized":"2024-01-19T05:01:34.288447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'136","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.453507+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T05:00:39.453507+0000","last_peered":"2024-01-19T05:00:39.453507+0000","last_clean":"2024-01-19T05:00:39.453507+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T05:00:39.453507+0000","last_undegraded":"2024-01-19T05:00:39.453507+0000","last_fullsized":"2024-01-19T05:00:39.453507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891164+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T05:01:41.891164+0000","last_peered":"2024-01-19T05:01:41.891164+0000","last_clean":"2024-01-19T05:01:41.891164+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T05:01:41.891164+0000","last_undegraded":"2024-01-19T05:01:41.891164+0000","last_fullsized":"2024-01-19T05:01:41.891164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:02.941137+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T05:01:02.941137+0000","last_peered":"2024-01-19T05:01:02.941137+0000","last_clean":"2024-01-19T05:01:02.941137+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T05:01:02.941137+0000","last_undegraded":"2024-01-19T05:01:02.941137+0000","last_fullsized":"2024-01-19T05:01:02.941137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:26.451904+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T05:00:26.451904+0000","last_peered":"2024-01-19T05:00:26.451904+0000","last_clean":"2024-01-19T05:00:26.451904+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T05:00:26.451904+0000","last_undegraded":"2024-01-19T05:00:26.451904+0000","last_fullsized":"2024-01-19T05:00:26.451904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.810961+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T05:01:41.810961+0000","last_peered":"2024-01-19T05:01:41.810961+0000","last_clean":"2024-01-19T05:01:41.810961+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T05:01:41.810961+0000","last_undegraded":"2024-01-19T05:01:41.810961+0000","last_fullsized":"2024-01-19T05:01:41.810961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'17","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.378730+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T05:01:41.378730+0000","last_peered":"2024-01-19T05:01:41.378730+0000","last_clean":"2024-01-19T05:01:41.378730+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T05:01:41.378730+0000","last_undegraded":"2024-01-19T05:01:41.378730+0000","last_fullsized":"2024-01-19T05:01:41.378730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'83","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:16.414257+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T05:00:16.414257+0000","last_peered":"2024-01-19T05:00:16.414257+0000","last_clean":"2024-01-19T05:00:16.414257+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T05:00:16.414257+0000","last_undegraded":"2024-01-19T05:00:16.414257+0000","last_fullsized":"2024-01-19T05:00:16.414257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'74","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.035231+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T05:00:29.035231+0000","last_peered":"2024-01-19T05:00:29.035231+0000","last_clean":"2024-01-19T05:00:29.035231+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T05:00:29.035231+0000","last_undegraded":"2024-01-19T05:00:29.035231+0000","last_fullsized":"2024-01-19T05:00:29.035231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.672750+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T05:01:41.672750+0000","last_peered":"2024-01-19T05:01:41.672750+0000","last_clean":"2024-01-19T05:01:41.672750+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T05:01:41.672750+0000","last_undegraded":"2024-01-19T05:01:41.672750+0000","last_fullsized":"2024-01-19T05:01:41.672750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.300615+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T05:01:31.300615+0000","last_peered":"2024-01-19T05:01:31.300615+0000","last_clean":"2024-01-19T05:01:31.300615+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T05:01:31.300615+0000","last_undegraded":"2024-01-19T05:01:31.300615+0000","last_fullsized":"2024-01-19T05:01:31.300615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.056917+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T05:00:40.056917+0000","last_peered":"2024-01-19T05:00:40.056917+0000","last_clean":"2024-01-19T05:00:40.056917+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T05:00:40.056917+0000","last_undegraded":"2024-01-19T05:00:40.056917+0000","last_fullsized":"2024-01-19T05:00:40.056917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":13922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892111+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T05:01:41.892111+0000","last_peered":"2024-01-19T05:01:41.892111+0000","last_clean":"2024-01-19T05:01:41.892111+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T05:01:41.892111+0000","last_undegraded":"2024-01-19T05:01:41.892111+0000","last_fullsized":"2024-01-19T05:01:41.892111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'4","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.109280+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T05:00:39.109280+0000","last_peered":"2024-01-19T05:00:39.109280+0000","last_clean":"2024-01-19T05:00:39.109280+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T05:00:39.109280+0000","last_undegraded":"2024-01-19T05:00:39.109280+0000","last_fullsized":"2024-01-19T05:00:39.109280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'646","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:16.645553+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T05:01:16.645553+0000","last_peered":"2024-01-19T05:01:16.645553+0000","last_clean":"2024-01-19T05:01:16.645553+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T05:01:16.645553+0000","last_undegraded":"2024-01-19T05:01:16.645553+0000","last_fullsized":"2024-01-19T05:01:16.645553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'25","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.898703+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T05:01:41.898703+0000","last_peered":"2024-01-19T05:01:41.898703+0000","last_clean":"2024-01-19T05:01:41.898703+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T05:01:41.898703+0000","last_undegraded":"2024-01-19T05:01:41.898703+0000","last_fullsized":"2024-01-19T05:01:41.898703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'47","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.204764+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T05:00:39.204764+0000","last_peered":"2024-01-19T05:00:39.204764+0000","last_clean":"2024-01-19T05:00:39.204764+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T05:00:39.204764+0000","last_undegraded":"2024-01-19T05:00:39.204764+0000","last_fullsized":"2024-01-19T05:00:39.204764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'584","reported_seq":617,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:33.977903+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T05:01:33.977903+0000","last_peered":"2024-01-19T05:01:33.977903+0000","last_clean":"2024-01-19T05:01:33.977903+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T05:01:33.977903+0000","last_undegraded":"2024-01-19T05:01:33.977903+0000","last_fullsized":"2024-01-19T05:01:33.977903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.697325+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T05:01:41.697325+0000","last_peered":"2024-01-19T05:01:41.697325+0000","last_clean":"2024-01-19T05:01:41.697325+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T05:01:41.697325+0000","last_undegraded":"2024-01-19T05:01:41.697325+0000","last_fullsized":"2024-01-19T05:01:41.697325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400511+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T05:00:39.400511+0000","last_peered":"2024-01-19T05:00:39.400511+0000","last_clean":"2024-01-19T05:00:39.400511+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T05:00:39.400511+0000","last_undegraded":"2024-01-19T05:00:39.400511+0000","last_fullsized":"2024-01-19T05:00:39.400511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983016+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T05:01:41.983016+0000","last_peered":"2024-01-19T05:01:41.983016+0000","last_clean":"2024-01-19T05:01:41.983016+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T05:01:41.983016+0000","last_undegraded":"2024-01-19T05:01:41.983016+0000","last_fullsized":"2024-01-19T05:01:41.983016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'30","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.998230+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T05:01:41.998230+0000","last_peered":"2024-01-19T05:01:41.998230+0000","last_clean":"2024-01-19T05:01:41.998230+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T05:01:41.998230+0000","last_undegraded":"2024-01-19T05:01:41.998230+0000","last_fullsized":"2024-01-19T05:01:41.998230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'28","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.693715+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T05:01:41.693715+0000","last_peered":"2024-01-19T05:01:41.693715+0000","last_clean":"2024-01-19T05:01:41.693715+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T05:01:41.693715+0000","last_undegraded":"2024-01-19T05:01:41.693715+0000","last_fullsized":"2024-01-19T05:01:41.693715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.897403+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T05:01:41.897403+0000","last_peered":"2024-01-19T05:01:41.897403+0000","last_clean":"2024-01-19T05:01:41.897403+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T05:01:41.897403+0000","last_undegraded":"2024-01-19T05:01:41.897403+0000","last_fullsized":"2024-01-19T05:01:41.897403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'17","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878880+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T05:01:41.878880+0000","last_peered":"2024-01-19T05:01:41.878880+0000","last_clean":"2024-01-19T05:01:41.878880+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T05:01:41.878880+0000","last_undegraded":"2024-01-19T05:01:41.878880+0000","last_fullsized":"2024-01-19T05:01:41.878880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'22","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.670021+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T05:01:41.670021+0000","last_peered":"2024-01-19T05:01:41.670021+0000","last_clean":"2024-01-19T05:01:41.670021+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T05:01:41.670021+0000","last_undegraded":"2024-01-19T05:01:41.670021+0000","last_fullsized":"2024-01-19T05:01:41.670021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'34","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.984301+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T05:01:41.984301+0000","last_peered":"2024-01-19T05:01:41.984301+0000","last_clean":"2024-01-19T05:01:41.984301+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T05:01:41.984301+0000","last_undegraded":"2024-01-19T05:01:41.984301+0000","last_fullsized":"2024-01-19T05:01:41.984301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.871897+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T05:01:41.871897+0000","last_peered":"2024-01-19T05:01:41.871897+0000","last_clean":"2024-01-19T05:01:41.871897+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T05:01:41.871897+0000","last_undegraded":"2024-01-19T05:01:41.871897+0000","last_fullsized":"2024-01-19T05:01:41.871897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.708579+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T05:01:41.708579+0000","last_peered":"2024-01-19T05:01:41.708579+0000","last_clean":"2024-01-19T05:01:41.708579+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T05:01:41.708579+0000","last_undegraded":"2024-01-19T05:01:41.708579+0000","last_fullsized":"2024-01-19T05:01:41.708579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879130+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T05:01:41.879130+0000","last_peered":"2024-01-19T05:01:41.879130+0000","last_clean":"2024-01-19T05:01:41.879130+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T05:01:41.879130+0000","last_undegraded":"2024-01-19T05:01:41.879130+0000","last_fullsized":"2024-01-19T05:01:41.879130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'27","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.811706+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T05:01:41.811706+0000","last_peered":"2024-01-19T05:01:41.811706+0000","last_clean":"2024-01-19T05:01:41.811706+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T05:01:41.811706+0000","last_undegraded":"2024-01-19T05:01:41.811706+0000","last_fullsized":"2024-01-19T05:01:41.811706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'31","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.898426+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T05:01:41.898426+0000","last_peered":"2024-01-19T05:01:41.898426+0000","last_clean":"2024-01-19T05:01:41.898426+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T05:01:41.898426+0000","last_undegraded":"2024-01-19T05:01:41.898426+0000","last_fullsized":"2024-01-19T05:01:41.898426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983450+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T05:01:41.983450+0000","last_peered":"2024-01-19T05:01:41.983450+0000","last_clean":"2024-01-19T05:01:41.983450+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T05:01:41.983450+0000","last_undegraded":"2024-01-19T05:01:41.983450+0000","last_fullsized":"2024-01-19T05:01:41.983450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706377+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T05:01:41.706377+0000","last_peered":"2024-01-19T05:01:41.706377+0000","last_clean":"2024-01-19T05:01:41.706377+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T05:01:41.706377+0000","last_undegraded":"2024-01-19T05:01:41.706377+0000","last_fullsized":"2024-01-19T05:01:41.706377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'31","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.996824+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T05:01:41.996824+0000","last_peered":"2024-01-19T05:01:41.996824+0000","last_clean":"2024-01-19T05:01:41.996824+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T05:01:41.996824+0000","last_undegraded":"2024-01-19T05:01:41.996824+0000","last_fullsized":"2024-01-19T05:01:41.996824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'27","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.993057+0000","last_change":"2024-01-19T04:32:37.020144+0000","last_active":"2024-01-19T05:01:41.993057+0000","last_peered":"2024-01-19T05:01:41.993057+0000","last_clean":"2024-01-19T05:01:41.993057+0000","last_became_active":"2024-01-19T04:32:37.019820+0000","last_became_peered":"2024-01-19T04:32:37.019820+0000","last_unstale":"2024-01-19T05:01:41.993057+0000","last_undegraded":"2024-01-19T05:01:41.993057+0000","last_fullsized":"2024-01-19T05:01:41.993057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:48.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'30","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.769347+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T05:01:41.769347+0000","last_peered":"2024-01-19T05:01:41.769347+0000","last_clean":"2024-01-19T05:01:41.769347+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T05:01:41.769347+0000","last_undegraded":"2024-01-19T05:01:41.769347+0000","last_fullsized":"2024-01-19T05:01:41.769347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'23","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669301+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T05:01:41.669301+0000","last_peered":"2024-01-19T05:01:41.669301+0000","last_clean":"2024-01-19T05:01:41.669301+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T05:01:41.669301+0000","last_undegraded":"2024-01-19T05:01:41.669301+0000","last_fullsized":"2024-01-19T05:01:41.669301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'25","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895367+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T05:01:41.895367+0000","last_peered":"2024-01-19T05:01:41.895367+0000","last_clean":"2024-01-19T05:01:41.895367+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T05:01:41.895367+0000","last_undegraded":"2024-01-19T05:01:41.895367+0000","last_fullsized":"2024-01-19T05:01:41.895367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'29","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.889958+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T05:01:41.889958+0000","last_peered":"2024-01-19T05:01:41.889958+0000","last_clean":"2024-01-19T05:01:41.889958+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T05:01:41.889958+0000","last_undegraded":"2024-01-19T05:01:41.889958+0000","last_fullsized":"2024-01-19T05:01:41.889958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704394+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T05:01:41.704394+0000","last_peered":"2024-01-19T05:01:41.704394+0000","last_clean":"2024-01-19T05:01:41.704394+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T05:01:41.704394+0000","last_undegraded":"2024-01-19T05:01:41.704394+0000","last_fullsized":"2024-01-19T05:01:41.704394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.980207+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T05:01:41.980207+0000","last_peered":"2024-01-19T05:01:41.980207+0000","last_clean":"2024-01-19T05:01:41.980207+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T05:01:41.980207+0000","last_undegraded":"2024-01-19T05:01:41.980207+0000","last_fullsized":"2024-01-19T05:01:41.980207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.986160+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T05:01:41.986160+0000","last_peered":"2024-01-19T05:01:41.986160+0000","last_clean":"2024-01-19T05:01:41.986160+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T05:01:41.986160+0000","last_undegraded":"2024-01-19T05:01:41.986160+0000","last_fullsized":"2024-01-19T05:01:41.986160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815246+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T05:01:41.815246+0000","last_peered":"2024-01-19T05:01:41.815246+0000","last_clean":"2024-01-19T05:01:41.815246+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T05:01:41.815246+0000","last_undegraded":"2024-01-19T05:01:41.815246+0000","last_fullsized":"2024-01-19T05:01:41.815246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'19","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892314+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T05:01:41.892314+0000","last_peered":"2024-01-19T05:01:41.892314+0000","last_clean":"2024-01-19T05:01:41.892314+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T05:01:41.892314+0000","last_undegraded":"2024-01-19T05:01:41.892314+0000","last_fullsized":"2024-01-19T05:01:41.892314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'21","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.679032+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T05:01:41.679032+0000","last_peered":"2024-01-19T05:01:41.679032+0000","last_clean":"2024-01-19T05:01:41.679032+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T05:01:41.679032+0000","last_undegraded":"2024-01-19T05:01:41.679032+0000","last_fullsized":"2024-01-19T05:01:41.679032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.746534+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T05:01:41.746534+0000","last_peered":"2024-01-19T05:01:41.746534+0000","last_clean":"2024-01-19T05:01:41.746534+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T05:01:41.746534+0000","last_undegraded":"2024-01-19T05:01:41.746534+0000","last_fullsized":"2024-01-19T05:01:41.746534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'24","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.668376+0000","last_change":"2024-01-19T04:32:36.986632+0000","last_active":"2024-01-19T05:01:41.668376+0000","last_peered":"2024-01-19T05:01:41.668376+0000","last_clean":"2024-01-19T05:01:41.668376+0000","last_became_active":"2024-01-19T04:32:36.986250+0000","last_became_peered":"2024-01-19T04:32:36.986250+0000","last_unstale":"2024-01-19T05:01:41.668376+0000","last_undegraded":"2024-01-19T05:01:41.668376+0000","last_fullsized":"2024-01-19T05:01:41.668376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:25:48.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.817181+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T05:01:41.817181+0000","last_peered":"2024-01-19T05:01:41.817181+0000","last_clean":"2024-01-19T05:01:41.817181+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T05:01:41.817181+0000","last_undegraded":"2024-01-19T05:01:41.817181+0000","last_fullsized":"2024-01-19T05:01:41.817181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'26","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880081+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T05:01:41.880081+0000","last_peered":"2024-01-19T05:01:41.880081+0000","last_clean":"2024-01-19T05:01:41.880081+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T05:01:41.880081+0000","last_undegraded":"2024-01-19T05:01:41.880081+0000","last_fullsized":"2024-01-19T05:01:41.880081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.660484+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T05:01:41.660484+0000","last_peered":"2024-01-19T05:01:41.660484+0000","last_clean":"2024-01-19T05:01:41.660484+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T05:01:41.660484+0000","last_undegraded":"2024-01-19T05:01:41.660484+0000","last_fullsized":"2024-01-19T05:01:41.660484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'24","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704922+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T05:01:41.704922+0000","last_peered":"2024-01-19T05:01:41.704922+0000","last_clean":"2024-01-19T05:01:41.704922+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T05:01:41.704922+0000","last_undegraded":"2024-01-19T05:01:41.704922+0000","last_fullsized":"2024-01-19T05:01:41.704922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2422,"num_write_kb":254160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2601,"ondisk_log_size":2601,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1580,"ondisk_log_size":1580,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24103801,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":5649,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48455680,"data_stored":48207602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5167,"ondisk_log_size":5167,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477112,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":495616,"data_stored":270316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.26100000000000001},"max":{"1min":1.2509999999999999,"5min":1.3160000000000001,"15min":2.2389999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.76200000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.29699999999999999},"max":{"1min":1.4099999999999999,"5min":1.4339999999999999,"15min":1.6739999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.309},"max":{"1min":1.264,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.875,"15min":0.81899999999999995},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.32200000000000001},"max":{"1min":1.202,"5min":1.754,"15min":1.754},"last":0.748}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.77300000000000002},"min":{"1min":0.45400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2709999999999999,"5min":2.52,"15min":2.52},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93799999999999994,"15min":0.90500000000000003},"min":{"1min":0.437,"5min":0.373,"15min":0.31900000000000001},"max":{"1min":1.321,"5min":1.5,"15min":2.0670000000000002},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0740000000000001,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":1.667,"15min":1.9590000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0820000000000001,"15min":1.0509999999999999},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.49,"5min":1.867,"15min":1.867},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1040000000000001,"15min":1.081},"min":{"1min":0.73399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.452,"5min":1.954,"15min":1.954},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":2.625,"15min":2.625},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.0880000000000001,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1599999999999999,"15min":1.1439999999999999},"min":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.57799999999999996},"max":{"1min":1.736,"5min":1.736,"15min":2.129},"last":1.155}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.151},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":1.913,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1890000000000001,"15min":1.119},"min":{"1min":0.84899999999999998,"5min":0.74399999999999999,"15min":0.60499999999999998},"max":{"1min":1.444,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.88100000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477113,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":140672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.4490000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.675},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.29399999999999998},"max":{"1min":1.22,"5min":1.244,"15min":1.4930000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.86199999999999999,"15min":0.84499999999999997},"min":{"1min":0.59299999999999997,"5min":0.40000000000000002,"15min":0.29499999999999998},"max":{"1min":1.466,"5min":1.468,"15min":1.486},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.68400000000000005,"5min":0.443,"15min":0.31900000000000001},"max":{"1min":1.1639999999999999,"5min":1.3140000000000001,"15min":1.6200000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.875,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.605,"15min":1.605},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.65700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3400000000000001,"5min":1.47,"15min":1.7689999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1160000000000001,"15min":1.1020000000000001},"min":{"1min":0.81200000000000006,"5min":0.69399999999999995,"15min":0.63300000000000001},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.9590000000000001},"last":1.258}]},{"osd":5,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0920000000000001},"min":{"1min":0.871,"5min":0.63300000000000001,"15min":0.60399999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.83699999999999997,"5min":0.56299999999999994,"15min":0.45500000000000002},"max":{"1min":1.5329999999999999,"5min":1.5469999999999999,"15min":1.72},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.133,"15min":1.1359999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0030000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.1850000000000001},"min":{"1min":0.94999999999999996,"5min":0.76700000000000002,"15min":0.61299999999999999},"max":{"1min":1.744,"5min":1.9139999999999999,"15min":2.0150000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.89200000000000002,"5min":0.73599999999999999,"15min":0.69099999999999995},"max":{"1min":1.921,"5min":1.921,"15min":2.2650000000000001},"last":1.1830000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509816,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":8744960,"data_stored":8529791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.46700000000000003,"15min":0.41799999999999998},"max":{"1min":1.2909999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.872,"15min":0.88200000000000001},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.4370000000000001,"15min":1.712},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96799999999999997,"15min":0.95499999999999996},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.2290000000000001,"5min":1.4359999999999999,"15min":1.5269999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94399999999999995,"15min":0.92300000000000004},"min":{"1min":0.59999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.3999999999999999},"last":1.048}]},{"osd":2,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.48799999999999999,"15min":0.46700000000000003},"max":{"1min":1.2490000000000001,"5min":1.462,"15min":1.5740000000000001},"last":0.747},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.96399999999999997},"min":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.55600000000000005},"max":{"1min":1.238,"5min":1.3400000000000001,"15min":1.4059999999999999},"last":0.88100000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.625,"5min":0.54500000000000004,"15min":0.46100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.4850000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.05,"15min":1.0409999999999999},"min":{"1min":0.75,"5min":0.60099999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.552,"15min":1.6180000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.68100000000000005,"5min":0.61899999999999999,"15min":0.58899999999999997},"max":{"1min":1.29,"5min":1.3360000000000001,"15min":1.8169999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0600000000000001,"15min":1.0660000000000001},"min":{"1min":0.59799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.472,"5min":1.486,"15min":1.7589999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.752,"5min":0.64300000000000002,"15min":0.45700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.657},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1140000000000001,"15min":1.1319999999999999},"min":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3839999999999999,"5min":1.46,"15min":1.698},"last":1.012}]},{"osd":7,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.145,"15min":1.141},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.3660000000000001,"5min":1.605,"15min":1.728},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1459999999999999,"15min":1.1379999999999999},"min":{"1min":0.90700000000000003,"5min":0.84999999999999998,"15min":0.68700000000000006},"max":{"1min":1.49,"5min":1.512,"15min":1.7769999999999999},"last":1.1080000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509816,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":143653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.84799999999999998,"15min":0.81499999999999995},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.433},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":3.2200000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95699999999999996,"15min":0.92400000000000004},"min":{"1min":0.63600000000000001,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.861}]},{"osd":1,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7729999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.91200000000000003},"min":{"1min":0.69699999999999995,"5min":0.55300000000000005,"15min":0.40300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.9730000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":0.98699999999999999},"min":{"1min":0.61699999999999999,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.9379999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.97199999999999998,"15min":0.94499999999999995},"min":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.51100000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":2.1760000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.0600000000000001},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.47399999999999998},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":2.6040000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0669999999999999,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.58899999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":2.0950000000000002}]},{"osd":4,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.90800000000000003,"15min":0.89400000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47899999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":2.7450000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.65000000000000002,"15min":0.51900000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":2.3999999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.028,"15min":1.0449999999999999},"min":{"1min":0.68600000000000005,"5min":0.58299999999999996,"15min":0.44900000000000001},"max":{"1min":1.3839999999999999,"5min":1.466,"15min":1.468},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.008,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.33200000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":2.8199999999999998}]},{"osd":7,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1839999999999999,"15min":1.171},"min":{"1min":1.016,"5min":0.79700000000000004,"15min":0.42399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":2.5139999999999998},{"interface":"front","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.64500000000000002,"15min":0.57999999999999996},"max":{"1min":1.5389999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.80800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":8744960,"data_stored":8529659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88100000000000001,"15min":0.88500000000000001},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1990000000000001,"5min":1.3109999999999999,"15min":2.04},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3089999999999999,"5min":1.4399999999999999,"15min":2.1970000000000001},"last":1.032},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.51500000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.6309999999999998},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.51300000000000001},"max":{"1min":1.3879999999999999,"5min":1.6279999999999999,"15min":2.7810000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64000000000000001,"5min":0.55100000000000005,"15min":0.504},"max":{"1min":1.5640000000000001,"5min":1.7,"15min":1.7},"last":1.1279999999999999}]},{"osd":3,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.008,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":2.4820000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.069,"15min":1.083},"min":{"1min":0.84399999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.339,"5min":1.5369999999999999,"15min":2.4399999999999999},"last":1.2829999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.46000000000000002},"max":{"1min":1.484,"5min":1.5149999999999999,"15min":1.9119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.034,"15min":1.054},"min":{"1min":0.70799999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":2.7160000000000002},"last":1.077}]},{"osd":6,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.115,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.474,"5min":1.502,"15min":2.3650000000000002},"last":1.355},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.095,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7549999999999999},"last":1.25}]},{"osd":7,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1080000000000001,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.601,"5min":1.601,"15min":3.1720000000000002},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.49,"5min":1.718,"15min":2.8999999999999999},"last":1.169}]}]},{"osd":3,"up_from":15,"seq":64424509816,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":11600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":11878400,"data_stored":11653269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.33600000000000002},"max":{"1min":1.0009999999999999,"5min":1.47,"15min":1.47},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.71699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.30599999999999999},"max":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.3109999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.33400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3069999999999999,"15min":1.4339999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85199999999999998,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.42499999999999999,"15min":0.36199999999999999},"max":{"1min":1.153,"5min":1.444,"15min":1.444},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.47599999999999998,"15min":0.376},"max":{"1min":1.397,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.88500000000000001},"min":{"1min":0.51300000000000001,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4870000000000001,"5min":1.5369999999999999,"15min":1.5680000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.5049999999999999,"15min":1.5580000000000001},"last":0.879},{"interface":"front","average":{"1min":1.071,"5min":1.103,"15min":1.075},"min":{"1min":0.78100000000000003,"5min":0.65100000000000002,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.0920000000000001},"min":{"1min":0.68700000000000006,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.728,"15min":1.728},"last":1.081},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.0580000000000001},"min":{"1min":0.74399999999999999,"5min":0.621,"15min":0.60299999999999998},"max":{"1min":1.6459999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0940000000000001,"15min":1.0649999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.56200000000000006},"max":{"1min":1.3939999999999999,"5min":1.569,"15min":1.734},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.165},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.004}]},{"osd":7,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1180000000000001},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.60999999999999999},"max":{"1min":1.5700000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.163,"15min":1.1240000000000001},"min":{"1min":0.93200000000000005,"5min":0.78300000000000003,"15min":0.69999999999999996},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.8340000000000001},"last":1.036}]}]},{"osd":7,"up_from":14,"seq":60129542520,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48564,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323276,"statfs":{"total":96636764160,"available":96587034624,"internally_reserved":0,"allocated":13545472,"data_stored":13315101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.372},"max":{"1min":1.212,"5min":1.577,"15min":1.577},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.65500000000000003,"5min":0.51100000000000001,"15min":0.47699999999999998},"max":{"1min":1.2150000000000001,"5min":1.294,"15min":1.4430000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.65300000000000002,"5min":0.55900000000000005,"15min":0.48899999999999999},"max":{"1min":1.22,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.94499999999999995,"15min":0.92000000000000004},"min":{"1min":0.73499999999999999,"5min":0.55100000000000005,"15min":0.48399999999999999},"max":{"1min":1.2889999999999999,"5min":1.3560000000000001,"15min":1.7549999999999999},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0069999999999999,"15min":0.999},"min":{"1min":0.67900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.325,"5min":1.4390000000000001,"15min":1.6319999999999999},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.04,"15min":1.0169999999999999},"min":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3240000000000001,"5min":1.5009999999999999,"15min":1.542},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.70899999999999996,"5min":0.51100000000000001,"15min":0.46500000000000002},"max":{"1min":1.1679999999999999,"5min":1.758,"15min":1.758},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40799999999999997},"max":{"1min":1.395,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.099},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0249999999999999,"15min":1.0549999999999999},"min":{"1min":0.70799999999999996,"5min":0.53500000000000003,"15min":0.40600000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6339999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0580000000000001,"15min":1.0549999999999999},"min":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.622},"max":{"1min":1.367,"5min":1.51,"15min":1.9259999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.087,"15min":1.093},"min":{"1min":0.626,"5min":0.61099999999999999,"15min":0.432},"max":{"1min":1.298,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.1359999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.45600000000000002},"max":{"1min":1.4550000000000001,"5min":1.4710000000000001,"15min":1.8480000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.67600000000000005},"max":{"1min":1.4219999999999999,"5min":1.5680000000000001,"15min":1.75},"last":1.284}]}]},{"osd":0,"up_from":14,"seq":60129542520,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34972,"kb_used_data":7956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336868,"statfs":{"total":96636764160,"available":96600952832,"internally_reserved":0,"allocated":8146944,"data_stored":7918997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69199999999999995,"15min":0.68300000000000005},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.29099999999999998},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":2.1629999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.42299999999999999,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.78100000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.317},"max":{"1min":1.216,"5min":1.861,"15min":1.861},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":1.3500000000000001,"5min":1.4770000000000001,"15min":2.2490000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.248},"max":{"1min":1.3140000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":1.7050000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.2130000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0249999999999999,"15min":1.0029999999999999},"min":{"1min":0.72199999999999998,"5min":0.56299999999999994,"15min":0.502},"max":{"1min":1.901,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0660000000000001,"15min":1.0589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.3330000000000002},"last":1.161}]},{"osd":5,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1040000000000001,"15min":1.109},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.46800000000000003},"max":{"1min":1.514,"5min":1.909,"15min":1.909},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.651,"5min":2.0840000000000001,"15min":2.1150000000000002},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1499999999999999,"15min":1.1299999999999999},"min":{"1min":0.73999999999999999,"5min":0.66600000000000004,"15min":0.61299999999999999},"max":{"1min":1.998,"5min":1.998,"15min":2.4500000000000002},"last":1.274},{"interface":"front","average":{"1min":1.202,"5min":1.1659999999999999,"15min":1.155},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.60799999999999998},"max":{"1min":1.591,"5min":1.831,"15min":1.964},"last":1.302}]},{"osd":7,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1970000000000001,"15min":1.1839999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.61399999999999999},"max":{"1min":1.589,"5min":1.968,"15min":1.968},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.845,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":7189489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":131176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11546624,"data_stored":11514129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:01:49.248 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-19T05:01:49.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:01:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91bacbf640 1 Processor -- start 2024-01-19T05:01:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91bacbf640 1 -- start start 2024-01-19T05:01:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91bacbf640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 0x7f91b4153770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91bacbf640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40c3e50 con 0x7f91b415ce10 2024-01-19T05:01:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91bacbf640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b406c680 con 0x7f91b40c9c60 2024-01-19T05:01:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91bacbf640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b406c4a0 con 0x7f91b4153300 2024-01-19T05:01:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91b8a5b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f91b415ce10 0x7f91b40c4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45320/0 (socket says 172.21.15.133:45320) 2024-01-19T05:01:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91b8a5b640 1 -- 172.21.15.133:0/1426889818 learned_addr learned my addr 172.21.15.133:0/1426889818 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.410+0000 7f91b925c640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 0x7f91b4153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.414+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211727256 0 0) 0x7f91b40c3e50 con 0x7f91b415ce10 2024-01-19T05:01:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.414+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f919c003530 con 0x7f91b415ce10 2024-01-19T05:01:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.414+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077475077 0 0) 0x7f91b406c680 con 0x7f91b40c9c60 2024-01-19T05:01:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.414+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b40c3e50 con 0x7f91b40c9c60 2024-01-19T05:01:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259592923 0 0) 0x7f919c003530 con 0x7f91b415ce10 2024-01-19T05:01:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 msgr2=0x7f91b4153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 0x7f91b4153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 >> v1:172.21.15.156:6789/0 conn(0x7f91b40c9c60 legacy=0x7f91b415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4153cb0 con 0x7f91b415ce10 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f91b0001680 con 0x7f91b415ce10 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 >> v1:172.21.15.133:6789/0 conn(0x7f91b415ce10 legacy=0x7f91b40c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f919c003b40 0x7f919c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919c0047d0 0x7f919c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 0x7f919c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b406c4a0 con 0x7f919c0047d0 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c00ba40 con 0x7f919c003b40 2024-01-19T05:01:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.418+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c00bc00 con 0x7f91b4153300 2024-01-19T05:01:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.422+0000 7f91abfff640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919c0047d0 0x7f919c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.422+0000 7f91abfff640 1 -- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 msgr2=0x7f919c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.422+0000 7f91abfff640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b4153300 0x7f919c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.422+0000 7f91abfff640 1 -- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f919c003b40 msgr2=0x7f919c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.422+0000 7f91abfff640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f919c003b40 0x7f919c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.422+0000 7f91abfff640 1 -- 172.21.15.133:0/1426889818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c003530 con 0x7f919c0047d0 2024-01-19T05:01:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.426+0000 7f91abfff640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919c0047d0 0x7f919c004c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91a40018d0 tx=0x7f91a401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ba8e729cd32635 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40a6040 con 0x7f919c0047d0 2024-01-19T05:01:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40052f0 con 0x7f919c0047d0 2024-01-19T05:01:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91ab7fe640 1 -- 172.21.15.133:0/1426889818 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4003600 con 0x7f919c0047d0 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91bacbf640 1 -- 172.21.15.133:0/1426889818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919c0047d0 msgr2=0x7f919c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91bacbf640 1 --2- 172.21.15.133:0/1426889818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919c0047d0 0x7f919c004c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91a40018d0 tx=0x7f91a401c560 comp rx=0 tx=0).stop 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91b925c640 1 -- 172.21.15.133:0/1426889818 reap_dead start 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91bacbf640 1 -- 172.21.15.133:0/1426889818 shutdown_connections 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91bacbf640 1 -- 172.21.15.133:0/1426889818 >> 172.21.15.133:0/1426889818 conn(0x7f91b408b5a0 msgr2=0x7f91b4071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91bacbf640 1 -- 172.21.15.133:0/1426889818 shutdown_connections 2024-01-19T05:01:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.430+0000 7f91bacbf640 1 -- 172.21.15.133:0/1426889818 wait complete. 2024-01-19T05:01:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 Processor -- start 2024-01-19T05:01:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 -- start start 2024-01-19T05:01:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b415b820 0x7f91b4158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b40b41c0 0x7f91b4159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b415a1b0 0x7f91b4148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b414de60 con 0x7f91b40b41c0 2024-01-19T05:01:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b41efe10 con 0x7f91b415a1b0 2024-01-19T05:01:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.434+0000 7f91bacbf640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b41f31e0 con 0x7f91b415b820 2024-01-19T05:01:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.438+0000 7f91b925c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b415a1b0 0x7f91b4148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.438+0000 7f91b8a5b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b415b820 0x7f91b4158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.438+0000 7f91b925c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b415a1b0 0x7f91b4148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:47194/0 (socket says 172.21.15.133:47194) 2024-01-19T05:01:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.438+0000 7f91b925c640 1 -- 172.21.15.133:0/4007750857 learned_addr learned my addr 172.21.15.133:0/4007750857 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.438+0000 7f91abfff640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b40b41c0 0x7f91b4159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.442+0000 7f91abfff640 1 -- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b415b820 msgr2=0x7f91b4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.442+0000 7f91abfff640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b415b820 0x7f91b4158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.442+0000 7f91abfff640 1 -- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b415a1b0 msgr2=0x7f91b4148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.442+0000 7f91abfff640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b415a1b0 0x7f91b4148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.442+0000 7f91abfff640 1 -- 172.21.15.133:0/4007750857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b41f2610 con 0x7f91b40b41c0 2024-01-19T05:01:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.446+0000 7f91abfff640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b40b41c0 0x7f91b4159300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f919c0057b0 tx=0x7f91a4019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.450+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4003d60 con 0x7f91b40b41c0 2024-01-19T05:01:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.450+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40a6030 con 0x7f91b40b41c0 2024-01-19T05:01:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.450+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4006a00 con 0x7f91b40b41c0 2024-01-19T05:01:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.450+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b41f28b0 con 0x7f91b40b41c0 2024-01-19T05:01:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.450+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b41f2e70 con 0x7f91b40b41c0 2024-01-19T05:01:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.450+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b4074340 con 0x7f91b40b41c0 2024-01-19T05:01:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.470+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f91a4007030 con 0x7f91b40b41c0 2024-01-19T05:01:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.474+0000 7f91a97fa640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f91a0066550 0x7f91a0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.474+0000 7f91b8a5b640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f91a0066550 0x7f91a0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.474+0000 7f91b8a5b640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f91a0066550 0x7f91a0068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91b0000c10 tx=0x7f91b00017a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.758+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91a40eee90 con 0x7f91b40b41c0 2024-01-19T05:01:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.758+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f91a40eb1d0 con 0x7f91b40b41c0 2024-01-19T05:01:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.922+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91b40c4380 con 0x7f91a0066550 2024-01-19T05:01:49.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.950+0000 7f91a97fa640 1 -- 172.21.15.133:0/4007750857 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369475 (secure 0 0 0) 0x7f91b00056b0 con 0x7f91a0066550 2024-01-19T05:01:49.953 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:01:49.955 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f91a0066550 msgr2=0x7f91a0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f91a0066550 0x7f91a0068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91b0000c10 tx=0x7f91b00017a0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b40b41c0 msgr2=0x7f91b4159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b40b41c0 0x7f91b4159300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f919c0057b0 tx=0x7f91a4019300 comp rx=0 tx=0).stop 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 shutdown_connections 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f91a0066550 0x7f91a0068a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b415a1b0 0x7f91b4148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b40b41c0 0x7f91b4159300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 --2- 172.21.15.133:0/4007750857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91b415b820 0x7f91b4158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 >> 172.21.15.133:0/4007750857 conn(0x7f91b408b5a0 msgr2=0x7f91b414bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 shutdown_connections 2024-01-19T05:01:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:49.954+0000 7f91bacbf640 1 -- 172.21.15.133:0/4007750857 wait complete. 2024-01-19T05:01:49.972 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":958,"stamp":"2024-01-19T05:01:48.414209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24694169,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":677,"num_read_kb":685,"num_write":8230,"num_write_kb":283324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9465,"ondisk_log_size":9465,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326848,"kb_used_data":51072,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754647872,"statfs":{"total":773094113280,"available":772759420928,"internally_reserved":0,"allocated":52297728,"data_stored":50501458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":282316336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10660,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005489"},"pg_stats":[{"pgid":"2.1f","version":"31'645","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:05.126879+0000","last_change":"2024-01-19T04:31:31.776606+0000","last_active":"2024-01-19T05:01:05.126879+0000","last_peered":"2024-01-19T05:01:05.126879+0000","last_clean":"2024-01-19T05:01:05.126879+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T05:01:05.126879+0000","last_undegraded":"2024-01-19T05:01:05.126879+0000","last_fullsized":"2024-01-19T05:01:05.126879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:53.383947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.885215+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T05:01:41.885215+0000","last_peered":"2024-01-19T05:01:41.885215+0000","last_clean":"2024-01-19T05:01:41.885215+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T05:01:41.885215+0000","last_undegraded":"2024-01-19T05:01:41.885215+0000","last_fullsized":"2024-01-19T05:01:41.885215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456294+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T05:00:39.456294+0000","last_peered":"2024-01-19T05:00:39.456294+0000","last_clean":"2024-01-19T05:00:39.456294+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T05:00:39.456294+0000","last_undegraded":"2024-01-19T05:00:39.456294+0000","last_fullsized":"2024-01-19T05:00:39.456294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'262","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:42.127587+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T05:01:42.127587+0000","last_peered":"2024-01-19T05:01:42.127587+0000","last_clean":"2024-01-19T05:01:42.127587+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T05:01:42.127587+0000","last_undegraded":"2024-01-19T05:01:42.127587+0000","last_fullsized":"2024-01-19T05:01:42.127587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2994311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891716+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T05:01:41.891716+0000","last_peered":"2024-01-19T05:01:41.891716+0000","last_clean":"2024-01-19T05:01:41.891716+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T05:01:41.891716+0000","last_undegraded":"2024-01-19T05:01:41.891716+0000","last_fullsized":"2024-01-19T05:01:41.891716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:16:04.858989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'79","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.912319+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T05:00:36.912319+0000","last_peered":"2024-01-19T05:00:36.912319+0000","last_clean":"2024-01-19T05:00:36.912319+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T05:00:36.912319+0000","last_undegraded":"2024-01-19T05:00:36.912319+0000","last_fullsized":"2024-01-19T05:00:36.912319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.961414+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T05:01:21.961414+0000","last_peered":"2024-01-19T05:01:21.961414+0000","last_clean":"2024-01-19T05:01:21.961414+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T05:01:21.961414+0000","last_undegraded":"2024-01-19T05:01:21.961414+0000","last_fullsized":"2024-01-19T05:01:21.961414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'21","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.818570+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T05:01:41.818570+0000","last_peered":"2024-01-19T05:01:41.818570+0000","last_clean":"2024-01-19T05:01:41.818570+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T05:01:41.818570+0000","last_undegraded":"2024-01-19T05:01:41.818570+0000","last_fullsized":"2024-01-19T05:01:41.818570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'86","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400126+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T05:00:39.400126+0000","last_peered":"2024-01-19T05:00:39.400126+0000","last_clean":"2024-01-19T05:00:39.400126+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T05:00:39.400126+0000","last_undegraded":"2024-01-19T05:00:39.400126+0000","last_fullsized":"2024-01-19T05:00:39.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.159984+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T05:01:27.159984+0000","last_peered":"2024-01-19T05:01:27.159984+0000","last_clean":"2024-01-19T05:01:27.159984+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T05:01:27.159984+0000","last_undegraded":"2024-01-19T05:01:27.159984+0000","last_fullsized":"2024-01-19T05:01:27.159984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.808509+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T05:01:41.808509+0000","last_peered":"2024-01-19T05:01:41.808509+0000","last_clean":"2024-01-19T05:01:41.808509+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T05:01:41.808509+0000","last_undegraded":"2024-01-19T05:01:41.808509+0000","last_fullsized":"2024-01-19T05:01:41.808509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'85","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.439380+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T05:00:37.439380+0000","last_peered":"2024-01-19T05:00:37.439380+0000","last_clean":"2024-01-19T05:00:37.439380+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T05:00:37.439380+0000","last_undegraded":"2024-01-19T05:00:37.439380+0000","last_fullsized":"2024-01-19T05:00:37.439380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983091+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T05:01:41.983091+0000","last_peered":"2024-01-19T05:01:41.983091+0000","last_clean":"2024-01-19T05:01:41.983091+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T05:01:41.983091+0000","last_undegraded":"2024-01-19T05:01:41.983091+0000","last_fullsized":"2024-01-19T05:01:41.983091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'676","reported_seq":711,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:25.018447+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T05:01:25.018447+0000","last_peered":"2024-01-19T05:01:25.018447+0000","last_clean":"2024-01-19T05:01:25.018447+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T05:01:25.018447+0000","last_undegraded":"2024-01-19T05:01:25.018447+0000","last_fullsized":"2024-01-19T05:01:25.018447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'66","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:35.377800+0000","last_change":"2024-01-19T04:32:37.510574+0000","last_active":"2024-01-19T05:00:35.377800+0000","last_peered":"2024-01-19T05:00:35.377800+0000","last_clean":"2024-01-19T05:00:35.377800+0000","last_became_active":"2024-01-19T04:32:37.509981+0000","last_became_peered":"2024-01-19T04:32:37.509981+0000","last_unstale":"2024-01-19T05:00:35.377800+0000","last_undegraded":"2024-01-19T05:00:35.377800+0000","last_fullsized":"2024-01-19T05:00:35.377800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:57:44.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895522+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T05:01:41.895522+0000","last_peered":"2024-01-19T05:01:41.895522+0000","last_clean":"2024-01-19T05:01:41.895522+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T05:01:41.895522+0000","last_undegraded":"2024-01-19T05:01:41.895522+0000","last_fullsized":"2024-01-19T05:01:41.895522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:57.737776+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T05:00:57.737776+0000","last_peered":"2024-01-19T05:00:57.737776+0000","last_clean":"2024-01-19T05:00:57.737776+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T05:00:57.737776+0000","last_undegraded":"2024-01-19T05:00:57.737776+0000","last_fullsized":"2024-01-19T05:00:57.737776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'75","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.777943+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T05:00:36.777943+0000","last_peered":"2024-01-19T05:00:36.777943+0000","last_clean":"2024-01-19T05:00:36.777943+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T05:00:36.777943+0000","last_undegraded":"2024-01-19T05:00:36.777943+0000","last_fullsized":"2024-01-19T05:00:36.777943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.888619+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T05:01:41.888619+0000","last_peered":"2024-01-19T05:01:41.888619+0000","last_clean":"2024-01-19T05:01:41.888619+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T05:01:41.888619+0000","last_undegraded":"2024-01-19T05:01:41.888619+0000","last_fullsized":"2024-01-19T05:01:41.888619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:54.689539+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T05:00:54.689539+0000","last_peered":"2024-01-19T05:00:54.689539+0000","last_clean":"2024-01-19T05:00:54.689539+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T05:00:54.689539+0000","last_undegraded":"2024-01-19T05:00:54.689539+0000","last_fullsized":"2024-01-19T05:00:54.689539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'84","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.128938+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T05:00:39.128938+0000","last_peered":"2024-01-19T05:00:39.128938+0000","last_clean":"2024-01-19T05:00:39.128938+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T05:00:39.128938+0000","last_undegraded":"2024-01-19T05:00:39.128938+0000","last_fullsized":"2024-01-19T05:00:39.128938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.129743+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T05:00:40.129743+0000","last_peered":"2024-01-19T05:00:40.129743+0000","last_clean":"2024-01-19T05:00:40.129743+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T05:00:40.129743+0000","last_undegraded":"2024-01-19T05:00:40.129743+0000","last_fullsized":"2024-01-19T05:00:40.129743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.960586+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T05:01:21.960586+0000","last_peered":"2024-01-19T05:01:21.960586+0000","last_clean":"2024-01-19T05:01:21.960586+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T05:01:21.960586+0000","last_undegraded":"2024-01-19T05:01:21.960586+0000","last_fullsized":"2024-01-19T05:01:21.960586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'64","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.178229+0000","last_change":"2024-01-19T04:32:37.173175+0000","last_active":"2024-01-19T05:00:40.178229+0000","last_peered":"2024-01-19T05:00:40.178229+0000","last_clean":"2024-01-19T05:00:40.178229+0000","last_became_active":"2024-01-19T04:32:37.172049+0000","last_became_peered":"2024-01-19T04:32:37.172049+0000","last_unstale":"2024-01-19T05:00:40.178229+0000","last_undegraded":"2024-01-19T05:00:40.178229+0000","last_fullsized":"2024-01-19T05:00:40.178229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:44:06.445358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880902+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T05:01:41.880902+0000","last_peered":"2024-01-19T05:01:41.880902+0000","last_clean":"2024-01-19T05:01:41.880902+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T05:01:41.880902+0000","last_undegraded":"2024-01-19T05:01:41.880902+0000","last_fullsized":"2024-01-19T05:01:41.880902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:37.761701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.160162+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T05:01:27.160162+0000","last_peered":"2024-01-19T05:01:27.160162+0000","last_clean":"2024-01-19T05:01:27.160162+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T05:01:27.160162+0000","last_undegraded":"2024-01-19T05:01:27.160162+0000","last_fullsized":"2024-01-19T05:01:27.160162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'70","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.078499+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T05:00:39.078499+0000","last_peered":"2024-01-19T05:00:39.078499+0000","last_clean":"2024-01-19T05:00:39.078499+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T05:00:39.078499+0000","last_undegraded":"2024-01-19T05:00:39.078499+0000","last_fullsized":"2024-01-19T05:00:39.078499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.883471+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T05:01:41.883471+0000","last_peered":"2024-01-19T05:01:41.883471+0000","last_clean":"2024-01-19T05:01:41.883471+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T05:01:41.883471+0000","last_undegraded":"2024-01-19T05:01:41.883471+0000","last_fullsized":"2024-01-19T05:01:41.883471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'338","reported_seq":372,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:35.559737+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T05:01:35.559737+0000","last_peered":"2024-01-19T05:01:35.559737+0000","last_clean":"2024-01-19T05:01:35.559737+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T05:01:35.559737+0000","last_undegraded":"2024-01-19T05:01:35.559737+0000","last_fullsized":"2024-01-19T05:01:35.559737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":914,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.935298+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T05:00:39.935298+0000","last_peered":"2024-01-19T05:00:39.935298+0000","last_clean":"2024-01-19T05:00:39.935298+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T05:00:39.935298+0000","last_undegraded":"2024-01-19T05:00:39.935298+0000","last_fullsized":"2024-01-19T05:00:39.935298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669743+0000","last_change":"2024-01-19T04:31:34.850825+0000","last_active":"2024-01-19T05:01:41.669743+0000","last_peered":"2024-01-19T05:01:41.669743+0000","last_clean":"2024-01-19T05:01:41.669743+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T05:01:41.669743+0000","last_undegraded":"2024-01-19T05:01:41.669743+0000","last_fullsized":"2024-01-19T05:01:41.669743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'7","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:22.945763+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T05:01:22.945763+0000","last_peered":"2024-01-19T05:01:22.945763+0000","last_clean":"2024-01-19T05:01:22.945763+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T05:01:22.945763+0000","last_undegraded":"2024-01-19T05:01:22.945763+0000","last_fullsized":"2024-01-19T05:01:22.945763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'70","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.167337+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T05:00:40.167337+0000","last_peered":"2024-01-19T05:00:40.167337+0000","last_clean":"2024-01-19T05:00:40.167337+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T05:00:40.167337+0000","last_undegraded":"2024-01-19T05:00:40.167337+0000","last_fullsized":"2024-01-19T05:00:40.167337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:51.500105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'19","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.992189+0000","last_change":"2024-01-19T04:32:36.019089+0000","last_active":"2024-01-19T05:01:41.992189+0000","last_peered":"2024-01-19T05:01:41.992189+0000","last_clean":"2024-01-19T05:01:41.992189+0000","last_became_active":"2024-01-19T04:32:36.018566+0000","last_became_peered":"2024-01-19T04:32:36.018566+0000","last_unstale":"2024-01-19T05:01:41.992189+0000","last_undegraded":"2024-01-19T05:01:41.992189+0000","last_fullsized":"2024-01-19T05:01:41.992189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:22.492389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:11.372976+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T05:01:11.372976+0000","last_peered":"2024-01-19T05:01:11.372976+0000","last_clean":"2024-01-19T05:01:11.372976+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T05:01:11.372976+0000","last_undegraded":"2024-01-19T05:01:11.372976+0000","last_fullsized":"2024-01-19T05:01:11.372976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:40.169075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'99","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.987631+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T05:00:39.987631+0000","last_peered":"2024-01-19T05:00:39.987631+0000","last_clean":"2024-01-19T05:00:39.987631+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T05:00:39.987631+0000","last_undegraded":"2024-01-19T05:00:39.987631+0000","last_fullsized":"2024-01-19T05:00:39.987631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:53:29.540440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'21","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.690377+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T05:01:41.690377+0000","last_peered":"2024-01-19T05:01:41.690377+0000","last_clean":"2024-01-19T05:01:41.690377+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T05:01:41.690377+0000","last_undegraded":"2024-01-19T05:01:41.690377+0000","last_fullsized":"2024-01-19T05:01:41.690377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.002220+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T05:01:01.002220+0000","last_peered":"2024-01-19T05:01:01.002220+0000","last_clean":"2024-01-19T05:01:01.002220+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T05:01:01.002220+0000","last_undegraded":"2024-01-19T05:01:01.002220+0000","last_fullsized":"2024-01-19T05:01:01.002220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'56","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.735552+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T05:00:37.735552+0000","last_peered":"2024-01-19T05:00:37.735552+0000","last_clean":"2024-01-19T05:00:37.735552+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T05:00:37.735552+0000","last_undegraded":"2024-01-19T05:00:37.735552+0000","last_fullsized":"2024-01-19T05:00:37.735552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'25","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669567+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T05:01:41.669567+0000","last_peered":"2024-01-19T05:01:41.669567+0000","last_clean":"2024-01-19T05:01:41.669567+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T05:01:41.669567+0000","last_undegraded":"2024-01-19T05:01:41.669567+0000","last_fullsized":"2024-01-19T05:01:41.669567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'571","reported_seq":1167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:36.783094+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T05:01:36.783094+0000","last_peered":"2024-01-19T05:01:36.783094+0000","last_clean":"2024-01-19T05:01:36.783094+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T05:01:36.783094+0000","last_undegraded":"2024-01-19T05:01:36.783094+0000","last_fullsized":"2024-01-19T05:01:36.783094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129245,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":569,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'65","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.340064+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T05:00:39.340064+0000","last_peered":"2024-01-19T05:00:39.340064+0000","last_clean":"2024-01-19T05:00:39.340064+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T05:00:39.340064+0000","last_undegraded":"2024-01-19T05:00:39.340064+0000","last_fullsized":"2024-01-19T05:00:39.340064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":6769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879997+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T05:01:41.879997+0000","last_peered":"2024-01-19T05:01:41.879997+0000","last_clean":"2024-01-19T05:01:41.879997+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T05:01:41.879997+0000","last_undegraded":"2024-01-19T05:01:41.879997+0000","last_fullsized":"2024-01-19T05:01:41.879997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:50.097893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.385654+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T05:01:31.385654+0000","last_peered":"2024-01-19T05:01:31.385654+0000","last_clean":"2024-01-19T05:01:31.385654+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T05:01:31.385654+0000","last_undegraded":"2024-01-19T05:01:31.385654+0000","last_fullsized":"2024-01-19T05:01:31.385654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'104","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.025716+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T05:00:39.025716+0000","last_peered":"2024-01-19T05:00:39.025716+0000","last_clean":"2024-01-19T05:00:39.025716+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T05:00:39.025716+0000","last_undegraded":"2024-01-19T05:00:39.025716+0000","last_fullsized":"2024-01-19T05:00:39.025716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:34.356151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":11574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878545+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T05:01:41.878545+0000","last_peered":"2024-01-19T05:01:41.878545+0000","last_clean":"2024-01-19T05:01:41.878545+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T05:01:41.878545+0000","last_undegraded":"2024-01-19T05:01:41.878545+0000","last_fullsized":"2024-01-19T05:01:41.878545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:51.495665+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T05:00:51.495665+0000","last_peered":"2024-01-19T05:00:51.495665+0000","last_clean":"2024-01-19T05:00:51.495665+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T05:00:51.495665+0000","last_undegraded":"2024-01-19T05:00:51.495665+0000","last_fullsized":"2024-01-19T05:00:51.495665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T04:58:56.813272+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:58:56.813272+0000","last_peered":"2024-01-19T04:58:56.813272+0000","last_clean":"2024-01-19T04:58:56.813272+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:58:56.813272+0000","last_undegraded":"2024-01-19T04:58:56.813272+0000","last_fullsized":"2024-01-19T04:58:56.813272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.104947+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T05:00:40.104947+0000","last_peered":"2024-01-19T05:00:40.104947+0000","last_clean":"2024-01-19T05:00:40.104947+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T05:00:40.104947+0000","last_undegraded":"2024-01-19T05:00:40.104947+0000","last_fullsized":"2024-01-19T05:00:40.104947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815761+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T05:01:41.815761+0000","last_peered":"2024-01-19T05:01:41.815761+0000","last_clean":"2024-01-19T05:01:41.815761+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T05:01:41.815761+0000","last_undegraded":"2024-01-19T05:01:41.815761+0000","last_fullsized":"2024-01-19T05:01:41.815761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'12","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:17.722407+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T05:01:17.722407+0000","last_peered":"2024-01-19T05:01:17.722407+0000","last_clean":"2024-01-19T05:01:17.722407+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T05:01:17.722407+0000","last_undegraded":"2024-01-19T05:01:17.722407+0000","last_fullsized":"2024-01-19T05:01:17.722407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:10.797449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'80","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:22.079775+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T05:00:22.079775+0000","last_peered":"2024-01-19T05:00:22.079775+0000","last_clean":"2024-01-19T05:00:22.079775+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T05:00:22.079775+0000","last_undegraded":"2024-01-19T05:00:22.079775+0000","last_fullsized":"2024-01-19T05:00:22.079775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'22","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.705546+0000","last_change":"2024-01-19T04:32:36.982936+0000","last_active":"2024-01-19T05:01:41.705546+0000","last_peered":"2024-01-19T05:01:41.705546+0000","last_clean":"2024-01-19T05:01:41.705546+0000","last_became_active":"2024-01-19T04:32:36.982330+0000","last_became_peered":"2024-01-19T04:32:36.982330+0000","last_unstale":"2024-01-19T05:01:41.705546+0000","last_undegraded":"2024-01-19T05:01:41.705546+0000","last_fullsized":"2024-01-19T05:01:41.705546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:39.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:07.272964+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T05:01:07.272964+0000","last_peered":"2024-01-19T05:01:07.272964+0000","last_clean":"2024-01-19T05:01:07.272964+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T05:01:07.272964+0000","last_undegraded":"2024-01-19T05:01:07.272964+0000","last_fullsized":"2024-01-19T05:01:07.272964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:14.779118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'75","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.202314+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T05:00:39.202314+0000","last_peered":"2024-01-19T05:00:39.202314+0000","last_clean":"2024-01-19T05:00:39.202314+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T05:00:39.202314+0000","last_undegraded":"2024-01-19T05:00:39.202314+0000","last_fullsized":"2024-01-19T05:00:39.202314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:08:01.193127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":9598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.819246+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T05:01:41.819246+0000","last_peered":"2024-01-19T05:01:41.819246+0000","last_clean":"2024-01-19T05:01:41.819246+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T05:01:41.819246+0000","last_undegraded":"2024-01-19T05:01:41.819246+0000","last_fullsized":"2024-01-19T05:01:41.819246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:26.074425+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T05:01:26.074425+0000","last_peered":"2024-01-19T05:01:26.074425+0000","last_clean":"2024-01-19T05:01:26.074425+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T05:01:26.074425+0000","last_undegraded":"2024-01-19T05:01:26.074425+0000","last_fullsized":"2024-01-19T05:01:26.074425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.016220+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T05:00:29.016220+0000","last_peered":"2024-01-19T05:00:29.016220+0000","last_clean":"2024-01-19T05:00:29.016220+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T05:00:29.016220+0000","last_undegraded":"2024-01-19T05:00:29.016220+0000","last_fullsized":"2024-01-19T05:00:29.016220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":7505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.801564+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T05:01:41.801564+0000","last_peered":"2024-01-19T05:01:41.801564+0000","last_clean":"2024-01-19T05:01:41.801564+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T05:01:41.801564+0000","last_undegraded":"2024-01-19T05:01:41.801564+0000","last_fullsized":"2024-01-19T05:01:41.801564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.025179+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T05:01:01.025179+0000","last_peered":"2024-01-19T05:01:01.025179+0000","last_clean":"2024-01-19T05:01:01.025179+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T05:01:01.025179+0000","last_undegraded":"2024-01-19T05:01:01.025179+0000","last_fullsized":"2024-01-19T05:01:01.025179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'111","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.227926+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T05:00:39.227926+0000","last_peered":"2024-01-19T05:00:39.227926+0000","last_clean":"2024-01-19T05:00:39.227926+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T05:00:39.227926+0000","last_undegraded":"2024-01-19T05:00:39.227926+0000","last_fullsized":"2024-01-19T05:00:39.227926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.782334+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T05:01:41.782334+0000","last_peered":"2024-01-19T05:01:41.782334+0000","last_clean":"2024-01-19T05:01:41.782334+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T05:01:41.782334+0000","last_undegraded":"2024-01-19T05:01:41.782334+0000","last_fullsized":"2024-01-19T05:01:41.782334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:17.722126+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T05:01:17.722126+0000","last_peered":"2024-01-19T05:01:17.722126+0000","last_clean":"2024-01-19T05:01:17.722126+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T05:01:17.722126+0000","last_undegraded":"2024-01-19T05:01:17.722126+0000","last_fullsized":"2024-01-19T05:01:17.722126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:40.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'79","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.455331+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T05:00:39.455331+0000","last_peered":"2024-01-19T05:00:39.455331+0000","last_clean":"2024-01-19T05:00:39.455331+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T05:00:39.455331+0000","last_undegraded":"2024-01-19T05:00:39.455331+0000","last_fullsized":"2024-01-19T05:00:39.455331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:04.390042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895659+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T05:01:41.895659+0000","last_peered":"2024-01-19T05:01:41.895659+0000","last_clean":"2024-01-19T05:01:41.895659+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T05:01:41.895659+0000","last_undegraded":"2024-01-19T05:01:41.895659+0000","last_fullsized":"2024-01-19T05:01:41.895659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.315399+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T05:01:31.315399+0000","last_peered":"2024-01-19T05:01:31.315399+0000","last_clean":"2024-01-19T05:01:31.315399+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T05:01:31.315399+0000","last_undegraded":"2024-01-19T05:01:31.315399+0000","last_fullsized":"2024-01-19T05:01:31.315399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'73","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456178+0000","last_change":"2024-01-19T04:32:37.173262+0000","last_active":"2024-01-19T05:00:39.456178+0000","last_peered":"2024-01-19T05:00:39.456178+0000","last_clean":"2024-01-19T05:00:39.456178+0000","last_became_active":"2024-01-19T04:32:37.172443+0000","last_became_peered":"2024-01-19T04:32:37.172443+0000","last_unstale":"2024-01-19T05:00:39.456178+0000","last_undegraded":"2024-01-19T05:00:39.456178+0000","last_fullsized":"2024-01-19T05:00:39.456178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:47.286856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.821645+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T05:01:41.821645+0000","last_peered":"2024-01-19T05:01:41.821645+0000","last_clean":"2024-01-19T05:01:41.821645+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T05:01:41.821645+0000","last_undegraded":"2024-01-19T05:01:41.821645+0000","last_fullsized":"2024-01-19T05:01:41.821645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'12","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:32.401009+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T05:01:32.401009+0000","last_peered":"2024-01-19T05:01:32.401009+0000","last_clean":"2024-01-19T05:01:32.401009+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T05:01:32.401009+0000","last_undegraded":"2024-01-19T05:01:32.401009+0000","last_fullsized":"2024-01-19T05:01:32.401009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.991388+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T05:00:39.991388+0000","last_peered":"2024-01-19T05:00:39.991388+0000","last_clean":"2024-01-19T05:00:39.991388+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T05:00:39.991388+0000","last_undegraded":"2024-01-19T05:00:39.991388+0000","last_fullsized":"2024-01-19T05:00:39.991388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'26","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895870+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T05:01:41.895870+0000","last_peered":"2024-01-19T05:01:41.895870+0000","last_clean":"2024-01-19T05:01:41.895870+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T05:01:41.895870+0000","last_undegraded":"2024-01-19T05:01:41.895870+0000","last_fullsized":"2024-01-19T05:01:41.895870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:03.465840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.004300+0000","last_change":"2024-01-19T04:31:31.806467+0000","last_active":"2024-01-19T05:01:01.004300+0000","last_peered":"2024-01-19T05:01:01.004300+0000","last_clean":"2024-01-19T05:01:01.004300+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T05:01:01.004300+0000","last_undegraded":"2024-01-19T05:01:01.004300+0000","last_fullsized":"2024-01-19T05:01:01.004300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:30:50.622009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'85","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.190851+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T05:00:39.190851+0000","last_peered":"2024-01-19T05:00:39.190851+0000","last_clean":"2024-01-19T05:00:39.190851+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T05:00:39.190851+0000","last_undegraded":"2024-01-19T05:00:39.190851+0000","last_fullsized":"2024-01-19T05:00:39.190851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.781396+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T05:01:41.781396+0000","last_peered":"2024-01-19T05:01:41.781396+0000","last_clean":"2024-01-19T05:01:41.781396+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T05:01:41.781396+0000","last_undegraded":"2024-01-19T05:01:41.781396+0000","last_fullsized":"2024-01-19T05:01:41.781396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'830","reported_seq":864,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:23.910166+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T05:01:23.910166+0000","last_peered":"2024-01-19T05:01:23.910166+0000","last_clean":"2024-01-19T05:01:23.910166+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T05:01:23.910166+0000","last_undegraded":"2024-01-19T05:01:23.910166+0000","last_fullsized":"2024-01-19T05:01:23.910166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":4574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.907056+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T05:00:36.907056+0000","last_peered":"2024-01-19T05:00:36.907056+0000","last_clean":"2024-01-19T05:00:36.907056+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T05:00:36.907056+0000","last_undegraded":"2024-01-19T05:00:36.907056+0000","last_fullsized":"2024-01-19T05:00:36.907056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'25","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706189+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T05:01:41.706189+0000","last_peered":"2024-01-19T05:01:41.706189+0000","last_clean":"2024-01-19T05:01:41.706189+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T05:01:41.706189+0000","last_undegraded":"2024-01-19T05:01:41.706189+0000","last_fullsized":"2024-01-19T05:01:41.706189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'388","reported_seq":421,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:34.288447+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T05:01:34.288447+0000","last_peered":"2024-01-19T05:01:34.288447+0000","last_clean":"2024-01-19T05:01:34.288447+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T05:01:34.288447+0000","last_undegraded":"2024-01-19T05:01:34.288447+0000","last_fullsized":"2024-01-19T05:01:34.288447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'136","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.453507+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T05:00:39.453507+0000","last_peered":"2024-01-19T05:00:39.453507+0000","last_clean":"2024-01-19T05:00:39.453507+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T05:00:39.453507+0000","last_undegraded":"2024-01-19T05:00:39.453507+0000","last_fullsized":"2024-01-19T05:00:39.453507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891164+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T05:01:41.891164+0000","last_peered":"2024-01-19T05:01:41.891164+0000","last_clean":"2024-01-19T05:01:41.891164+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T05:01:41.891164+0000","last_undegraded":"2024-01-19T05:01:41.891164+0000","last_fullsized":"2024-01-19T05:01:41.891164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:03.859741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:02.941137+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T05:01:02.941137+0000","last_peered":"2024-01-19T05:01:02.941137+0000","last_clean":"2024-01-19T05:01:02.941137+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T05:01:02.941137+0000","last_undegraded":"2024-01-19T05:01:02.941137+0000","last_fullsized":"2024-01-19T05:01:02.941137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:26.451904+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T05:00:26.451904+0000","last_peered":"2024-01-19T05:00:26.451904+0000","last_clean":"2024-01-19T05:00:26.451904+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T05:00:26.451904+0000","last_undegraded":"2024-01-19T05:00:26.451904+0000","last_fullsized":"2024-01-19T05:00:26.451904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.810961+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T05:01:41.810961+0000","last_peered":"2024-01-19T05:01:41.810961+0000","last_clean":"2024-01-19T05:01:41.810961+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T05:01:41.810961+0000","last_undegraded":"2024-01-19T05:01:41.810961+0000","last_fullsized":"2024-01-19T05:01:41.810961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'17","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.378730+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T05:01:41.378730+0000","last_peered":"2024-01-19T05:01:41.378730+0000","last_clean":"2024-01-19T05:01:41.378730+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T05:01:41.378730+0000","last_undegraded":"2024-01-19T05:01:41.378730+0000","last_fullsized":"2024-01-19T05:01:41.378730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'83","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:16.414257+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T05:00:16.414257+0000","last_peered":"2024-01-19T05:00:16.414257+0000","last_clean":"2024-01-19T05:00:16.414257+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T05:00:16.414257+0000","last_undegraded":"2024-01-19T05:00:16.414257+0000","last_fullsized":"2024-01-19T05:00:16.414257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'74","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.035231+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T05:00:29.035231+0000","last_peered":"2024-01-19T05:00:29.035231+0000","last_clean":"2024-01-19T05:00:29.035231+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T05:00:29.035231+0000","last_undegraded":"2024-01-19T05:00:29.035231+0000","last_fullsized":"2024-01-19T05:00:29.035231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:23.697219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.672750+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T05:01:41.672750+0000","last_peered":"2024-01-19T05:01:41.672750+0000","last_clean":"2024-01-19T05:01:41.672750+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T05:01:41.672750+0000","last_undegraded":"2024-01-19T05:01:41.672750+0000","last_fullsized":"2024-01-19T05:01:41.672750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.300615+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T05:01:31.300615+0000","last_peered":"2024-01-19T05:01:31.300615+0000","last_clean":"2024-01-19T05:01:31.300615+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T05:01:31.300615+0000","last_undegraded":"2024-01-19T05:01:31.300615+0000","last_fullsized":"2024-01-19T05:01:31.300615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.056917+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T05:00:40.056917+0000","last_peered":"2024-01-19T05:00:40.056917+0000","last_clean":"2024-01-19T05:00:40.056917+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T05:00:40.056917+0000","last_undegraded":"2024-01-19T05:00:40.056917+0000","last_fullsized":"2024-01-19T05:00:40.056917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":13922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892111+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T05:01:41.892111+0000","last_peered":"2024-01-19T05:01:41.892111+0000","last_clean":"2024-01-19T05:01:41.892111+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T05:01:41.892111+0000","last_undegraded":"2024-01-19T05:01:41.892111+0000","last_fullsized":"2024-01-19T05:01:41.892111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'4","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.109280+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T05:00:39.109280+0000","last_peered":"2024-01-19T05:00:39.109280+0000","last_clean":"2024-01-19T05:00:39.109280+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T05:00:39.109280+0000","last_undegraded":"2024-01-19T05:00:39.109280+0000","last_fullsized":"2024-01-19T05:00:39.109280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'646","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:16.645553+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T05:01:16.645553+0000","last_peered":"2024-01-19T05:01:16.645553+0000","last_clean":"2024-01-19T05:01:16.645553+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T05:01:16.645553+0000","last_undegraded":"2024-01-19T05:01:16.645553+0000","last_fullsized":"2024-01-19T05:01:16.645553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'25","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.898703+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T05:01:41.898703+0000","last_peered":"2024-01-19T05:01:41.898703+0000","last_clean":"2024-01-19T05:01:41.898703+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T05:01:41.898703+0000","last_undegraded":"2024-01-19T05:01:41.898703+0000","last_fullsized":"2024-01-19T05:01:41.898703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:35.018021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'47","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.204764+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T05:00:39.204764+0000","last_peered":"2024-01-19T05:00:39.204764+0000","last_clean":"2024-01-19T05:00:39.204764+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T05:00:39.204764+0000","last_undegraded":"2024-01-19T05:00:39.204764+0000","last_fullsized":"2024-01-19T05:00:39.204764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:43.903088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'584","reported_seq":617,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:33.977903+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T05:01:33.977903+0000","last_peered":"2024-01-19T05:01:33.977903+0000","last_clean":"2024-01-19T05:01:33.977903+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T05:01:33.977903+0000","last_undegraded":"2024-01-19T05:01:33.977903+0000","last_fullsized":"2024-01-19T05:01:33.977903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.697325+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T05:01:41.697325+0000","last_peered":"2024-01-19T05:01:41.697325+0000","last_clean":"2024-01-19T05:01:41.697325+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T05:01:41.697325+0000","last_undegraded":"2024-01-19T05:01:41.697325+0000","last_fullsized":"2024-01-19T05:01:41.697325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400511+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T05:00:39.400511+0000","last_peered":"2024-01-19T05:00:39.400511+0000","last_clean":"2024-01-19T05:00:39.400511+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T05:00:39.400511+0000","last_undegraded":"2024-01-19T05:00:39.400511+0000","last_fullsized":"2024-01-19T05:00:39.400511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983016+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T05:01:41.983016+0000","last_peered":"2024-01-19T05:01:41.983016+0000","last_clean":"2024-01-19T05:01:41.983016+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T05:01:41.983016+0000","last_undegraded":"2024-01-19T05:01:41.983016+0000","last_fullsized":"2024-01-19T05:01:41.983016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'30","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.998230+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T05:01:41.998230+0000","last_peered":"2024-01-19T05:01:41.998230+0000","last_clean":"2024-01-19T05:01:41.998230+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T05:01:41.998230+0000","last_undegraded":"2024-01-19T05:01:41.998230+0000","last_fullsized":"2024-01-19T05:01:41.998230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:21.013291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'28","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.693715+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T05:01:41.693715+0000","last_peered":"2024-01-19T05:01:41.693715+0000","last_clean":"2024-01-19T05:01:41.693715+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T05:01:41.693715+0000","last_undegraded":"2024-01-19T05:01:41.693715+0000","last_fullsized":"2024-01-19T05:01:41.693715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.897403+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T05:01:41.897403+0000","last_peered":"2024-01-19T05:01:41.897403+0000","last_clean":"2024-01-19T05:01:41.897403+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T05:01:41.897403+0000","last_undegraded":"2024-01-19T05:01:41.897403+0000","last_fullsized":"2024-01-19T05:01:41.897403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:38.339028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'17","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878880+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T05:01:41.878880+0000","last_peered":"2024-01-19T05:01:41.878880+0000","last_clean":"2024-01-19T05:01:41.878880+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T05:01:41.878880+0000","last_undegraded":"2024-01-19T05:01:41.878880+0000","last_fullsized":"2024-01-19T05:01:41.878880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'22","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.670021+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T05:01:41.670021+0000","last_peered":"2024-01-19T05:01:41.670021+0000","last_clean":"2024-01-19T05:01:41.670021+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T05:01:41.670021+0000","last_undegraded":"2024-01-19T05:01:41.670021+0000","last_fullsized":"2024-01-19T05:01:41.670021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'34","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.984301+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T05:01:41.984301+0000","last_peered":"2024-01-19T05:01:41.984301+0000","last_clean":"2024-01-19T05:01:41.984301+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T05:01:41.984301+0000","last_undegraded":"2024-01-19T05:01:41.984301+0000","last_fullsized":"2024-01-19T05:01:41.984301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.871897+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T05:01:41.871897+0000","last_peered":"2024-01-19T05:01:41.871897+0000","last_clean":"2024-01-19T05:01:41.871897+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T05:01:41.871897+0000","last_undegraded":"2024-01-19T05:01:41.871897+0000","last_fullsized":"2024-01-19T05:01:41.871897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.708579+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T05:01:41.708579+0000","last_peered":"2024-01-19T05:01:41.708579+0000","last_clean":"2024-01-19T05:01:41.708579+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T05:01:41.708579+0000","last_undegraded":"2024-01-19T05:01:41.708579+0000","last_fullsized":"2024-01-19T05:01:41.708579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879130+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T05:01:41.879130+0000","last_peered":"2024-01-19T05:01:41.879130+0000","last_clean":"2024-01-19T05:01:41.879130+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T05:01:41.879130+0000","last_undegraded":"2024-01-19T05:01:41.879130+0000","last_fullsized":"2024-01-19T05:01:41.879130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'27","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.811706+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T05:01:41.811706+0000","last_peered":"2024-01-19T05:01:41.811706+0000","last_clean":"2024-01-19T05:01:41.811706+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T05:01:41.811706+0000","last_undegraded":"2024-01-19T05:01:41.811706+0000","last_fullsized":"2024-01-19T05:01:41.811706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'31","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.898426+0000","last_change":"2024-01-19T04:31:32.993866+0000","last_active":"2024-01-19T05:01:41.898426+0000","last_peered":"2024-01-19T05:01:41.898426+0000","last_clean":"2024-01-19T05:01:41.898426+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T05:01:41.898426+0000","last_undegraded":"2024-01-19T05:01:41.898426+0000","last_fullsized":"2024-01-19T05:01:41.898426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:09:11.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983450+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T05:01:41.983450+0000","last_peered":"2024-01-19T05:01:41.983450+0000","last_clean":"2024-01-19T05:01:41.983450+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T05:01:41.983450+0000","last_undegraded":"2024-01-19T05:01:41.983450+0000","last_fullsized":"2024-01-19T05:01:41.983450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706377+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T05:01:41.706377+0000","last_peered":"2024-01-19T05:01:41.706377+0000","last_clean":"2024-01-19T05:01:41.706377+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T05:01:41.706377+0000","last_undegraded":"2024-01-19T05:01:41.706377+0000","last_fullsized":"2024-01-19T05:01:41.706377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'31","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.996824+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T05:01:41.996824+0000","last_peered":"2024-01-19T05:01:41.996824+0000","last_clean":"2024-01-19T05:01:41.996824+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T05:01:41.996824+0000","last_undegraded":"2024-01-19T05:01:41.996824+0000","last_fullsized":"2024-01-19T05:01:41.996824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:15.861962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'27","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.993057+0000","last_change":"2024-01-19T04:32:37.020144+0000","last_active":"2024-01-19T05:01:41.993057+0000","last_peered":"2024-01-19T05:01:41.993057+0000","last_clean":"2024-01-19T05:01:41.993057+0000","last_became_active":"2024-01-19T04:32:37.019820+0000","last_became_peered":"2024-01-19T04:32:37.019820+0000","last_unstale":"2024-01-19T05:01:41.993057+0000","last_undegraded":"2024-01-19T05:01:41.993057+0000","last_fullsized":"2024-01-19T05:01:41.993057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:48.176207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'30","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.769347+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T05:01:41.769347+0000","last_peered":"2024-01-19T05:01:41.769347+0000","last_clean":"2024-01-19T05:01:41.769347+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T05:01:41.769347+0000","last_undegraded":"2024-01-19T05:01:41.769347+0000","last_fullsized":"2024-01-19T05:01:41.769347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'23","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.669301+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T05:01:41.669301+0000","last_peered":"2024-01-19T05:01:41.669301+0000","last_clean":"2024-01-19T05:01:41.669301+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T05:01:41.669301+0000","last_undegraded":"2024-01-19T05:01:41.669301+0000","last_fullsized":"2024-01-19T05:01:41.669301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'25","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895367+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T05:01:41.895367+0000","last_peered":"2024-01-19T05:01:41.895367+0000","last_clean":"2024-01-19T05:01:41.895367+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T05:01:41.895367+0000","last_undegraded":"2024-01-19T05:01:41.895367+0000","last_fullsized":"2024-01-19T05:01:41.895367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.057555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'29","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.889958+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T05:01:41.889958+0000","last_peered":"2024-01-19T05:01:41.889958+0000","last_clean":"2024-01-19T05:01:41.889958+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T05:01:41.889958+0000","last_undegraded":"2024-01-19T05:01:41.889958+0000","last_fullsized":"2024-01-19T05:01:41.889958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704394+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T05:01:41.704394+0000","last_peered":"2024-01-19T05:01:41.704394+0000","last_clean":"2024-01-19T05:01:41.704394+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T05:01:41.704394+0000","last_undegraded":"2024-01-19T05:01:41.704394+0000","last_fullsized":"2024-01-19T05:01:41.704394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.980207+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T05:01:41.980207+0000","last_peered":"2024-01-19T05:01:41.980207+0000","last_clean":"2024-01-19T05:01:41.980207+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T05:01:41.980207+0000","last_undegraded":"2024-01-19T05:01:41.980207+0000","last_fullsized":"2024-01-19T05:01:41.980207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.986160+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T05:01:41.986160+0000","last_peered":"2024-01-19T05:01:41.986160+0000","last_clean":"2024-01-19T05:01:41.986160+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T05:01:41.986160+0000","last_undegraded":"2024-01-19T05:01:41.986160+0000","last_fullsized":"2024-01-19T05:01:41.986160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815246+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T05:01:41.815246+0000","last_peered":"2024-01-19T05:01:41.815246+0000","last_clean":"2024-01-19T05:01:41.815246+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T05:01:41.815246+0000","last_undegraded":"2024-01-19T05:01:41.815246+0000","last_fullsized":"2024-01-19T05:01:41.815246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'19","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892314+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T05:01:41.892314+0000","last_peered":"2024-01-19T05:01:41.892314+0000","last_clean":"2024-01-19T05:01:41.892314+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T05:01:41.892314+0000","last_undegraded":"2024-01-19T05:01:41.892314+0000","last_fullsized":"2024-01-19T05:01:41.892314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'21","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.679032+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T05:01:41.679032+0000","last_peered":"2024-01-19T05:01:41.679032+0000","last_clean":"2024-01-19T05:01:41.679032+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T05:01:41.679032+0000","last_undegraded":"2024-01-19T05:01:41.679032+0000","last_fullsized":"2024-01-19T05:01:41.679032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.746534+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T05:01:41.746534+0000","last_peered":"2024-01-19T05:01:41.746534+0000","last_clean":"2024-01-19T05:01:41.746534+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T05:01:41.746534+0000","last_undegraded":"2024-01-19T05:01:41.746534+0000","last_fullsized":"2024-01-19T05:01:41.746534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'24","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.668376+0000","last_change":"2024-01-19T04:32:36.986632+0000","last_active":"2024-01-19T05:01:41.668376+0000","last_peered":"2024-01-19T05:01:41.668376+0000","last_clean":"2024-01-19T05:01:41.668376+0000","last_became_active":"2024-01-19T04:32:36.986250+0000","last_became_peered":"2024-01-19T04:32:36.986250+0000","last_unstale":"2024-01-19T05:01:41.668376+0000","last_undegraded":"2024-01-19T05:01:41.668376+0000","last_fullsized":"2024-01-19T05:01:41.668376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:25:48.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.817181+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T05:01:41.817181+0000","last_peered":"2024-01-19T05:01:41.817181+0000","last_clean":"2024-01-19T05:01:41.817181+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T05:01:41.817181+0000","last_undegraded":"2024-01-19T05:01:41.817181+0000","last_fullsized":"2024-01-19T05:01:41.817181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'26","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880081+0000","last_change":"2024-01-19T04:31:33.073271+0000","last_active":"2024-01-19T05:01:41.880081+0000","last_peered":"2024-01-19T05:01:41.880081+0000","last_clean":"2024-01-19T05:01:41.880081+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T05:01:41.880081+0000","last_undegraded":"2024-01-19T05:01:41.880081+0000","last_fullsized":"2024-01-19T05:01:41.880081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:32.380468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.660484+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T05:01:41.660484+0000","last_peered":"2024-01-19T05:01:41.660484+0000","last_clean":"2024-01-19T05:01:41.660484+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T05:01:41.660484+0000","last_undegraded":"2024-01-19T05:01:41.660484+0000","last_fullsized":"2024-01-19T05:01:41.660484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'24","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704922+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T05:01:41.704922+0000","last_peered":"2024-01-19T05:01:41.704922+0000","last_clean":"2024-01-19T05:01:41.704922+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T05:01:41.704922+0000","last_undegraded":"2024-01-19T05:01:41.704922+0000","last_fullsized":"2024-01-19T05:01:41.704922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2422,"num_write_kb":254160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2601,"ondisk_log_size":2601,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1580,"ondisk_log_size":1580,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24103801,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":5649,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48455680,"data_stored":48207602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5167,"ondisk_log_size":5167,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477112,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":495616,"data_stored":270316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.26100000000000001},"max":{"1min":1.2509999999999999,"5min":1.3160000000000001,"15min":2.2389999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.76200000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.29699999999999999},"max":{"1min":1.4099999999999999,"5min":1.4339999999999999,"15min":1.6739999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.309},"max":{"1min":1.264,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.875,"15min":0.81899999999999995},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.32200000000000001},"max":{"1min":1.202,"5min":1.754,"15min":1.754},"last":0.748}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.77300000000000002},"min":{"1min":0.45400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2709999999999999,"5min":2.52,"15min":2.52},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93799999999999994,"15min":0.90500000000000003},"min":{"1min":0.437,"5min":0.373,"15min":0.31900000000000001},"max":{"1min":1.321,"5min":1.5,"15min":2.0670000000000002},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0740000000000001,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":1.667,"15min":1.9590000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0820000000000001,"15min":1.0509999999999999},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.49,"5min":1.867,"15min":1.867},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1040000000000001,"15min":1.081},"min":{"1min":0.73399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.452,"5min":1.954,"15min":1.954},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":2.625,"15min":2.625},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.0880000000000001,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1599999999999999,"15min":1.1439999999999999},"min":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.57799999999999996},"max":{"1min":1.736,"5min":1.736,"15min":2.129},"last":1.155}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.151},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":1.913,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1890000000000001,"15min":1.119},"min":{"1min":0.84899999999999998,"5min":0.74399999999999999,"15min":0.60499999999999998},"max":{"1min":1.444,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.88100000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477113,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":140672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.4490000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.675},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.29399999999999998},"max":{"1min":1.22,"5min":1.244,"15min":1.4930000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.86199999999999999,"15min":0.84499999999999997},"min":{"1min":0.59299999999999997,"5min":0.40000000000000002,"15min":0.29499999999999998},"max":{"1min":1.466,"5min":1.468,"15min":1.486},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.68400000000000005,"5min":0.443,"15min":0.31900000000000001},"max":{"1min":1.1639999999999999,"5min":1.3140000000000001,"15min":1.6200000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.875,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.605,"15min":1.605},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.65700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3400000000000001,"5min":1.47,"15min":1.7689999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1160000000000001,"15min":1.1020000000000001},"min":{"1min":0.81200000000000006,"5min":0.69399999999999995,"15min":0.63300000000000001},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.9590000000000001},"last":1.258}]},{"osd":5,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0920000000000001},"min":{"1min":0.871,"5min":0.63300000000000001,"15min":0.60399999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.83699999999999997,"5min":0.56299999999999994,"15min":0.45500000000000002},"max":{"1min":1.5329999999999999,"5min":1.5469999999999999,"15min":1.72},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.133,"15min":1.1359999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0030000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.1850000000000001},"min":{"1min":0.94999999999999996,"5min":0.76700000000000002,"15min":0.61299999999999999},"max":{"1min":1.744,"5min":1.9139999999999999,"15min":2.0150000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.89200000000000002,"5min":0.73599999999999999,"15min":0.69099999999999995},"max":{"1min":1.921,"5min":1.921,"15min":2.2650000000000001},"last":1.1830000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509816,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":8744960,"data_stored":8529791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.46700000000000003,"15min":0.41799999999999998},"max":{"1min":1.2909999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.872,"15min":0.88200000000000001},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.4370000000000001,"15min":1.712},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96799999999999997,"15min":0.95499999999999996},"min":{"1min":0.72699999999999998,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.2290000000000001,"5min":1.4359999999999999,"15min":1.5269999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94399999999999995,"15min":0.92300000000000004},"min":{"1min":0.59999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.3999999999999999},"last":1.048}]},{"osd":2,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.48799999999999999,"15min":0.46700000000000003},"max":{"1min":1.2490000000000001,"5min":1.462,"15min":1.5740000000000001},"last":0.747},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.96399999999999997},"min":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.55600000000000005},"max":{"1min":1.238,"5min":1.3400000000000001,"15min":1.4059999999999999},"last":0.88100000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.625,"5min":0.54500000000000004,"15min":0.46100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.4850000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.05,"15min":1.0409999999999999},"min":{"1min":0.75,"5min":0.60099999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.552,"15min":1.6180000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92800000000000005,"15min":0.93700000000000006},"min":{"1min":0.68100000000000005,"5min":0.61899999999999999,"15min":0.58899999999999997},"max":{"1min":1.29,"5min":1.3360000000000001,"15min":1.8169999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0600000000000001,"15min":1.0660000000000001},"min":{"1min":0.59799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.472,"5min":1.486,"15min":1.7589999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.752,"5min":0.64300000000000002,"15min":0.45700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.657},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.1140000000000001,"15min":1.1319999999999999},"min":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3839999999999999,"5min":1.46,"15min":1.698},"last":1.012}]},{"osd":7,"last update":"Fri Jan 19 05:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.145,"15min":1.141},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.621},"max":{"1min":1.3660000000000001,"5min":1.605,"15min":1.728},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1459999999999999,"15min":1.1379999999999999},"min":{"1min":0.90700000000000003,"5min":0.84999999999999998,"15min":0.68700000000000006},"max":{"1min":1.49,"5min":1.512,"15min":1.7769999999999999},"last":1.1080000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509816,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":143653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.84799999999999998,"15min":0.81499999999999995},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.433},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":3.2200000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95699999999999996,"15min":0.92400000000000004},"min":{"1min":0.63600000000000001,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.861}]},{"osd":1,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7729999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.91200000000000003},"min":{"1min":0.69699999999999995,"5min":0.55300000000000005,"15min":0.40300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.9730000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":0.98699999999999999},"min":{"1min":0.61699999999999999,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.9379999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.97199999999999998,"15min":0.94499999999999995},"min":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.51100000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":2.1760000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.0600000000000001},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.47399999999999998},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":2.6040000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0669999999999999,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.58899999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":2.0950000000000002}]},{"osd":4,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.90800000000000003,"15min":0.89400000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47899999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":2.7450000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.65000000000000002,"15min":0.51900000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":2.3999999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.028,"15min":1.0449999999999999},"min":{"1min":0.68600000000000005,"5min":0.58299999999999996,"15min":0.44900000000000001},"max":{"1min":1.3839999999999999,"5min":1.466,"15min":1.468},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.008,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.33200000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":2.8199999999999998}]},{"osd":7,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1839999999999999,"15min":1.171},"min":{"1min":1.016,"5min":0.79700000000000004,"15min":0.42399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":2.5139999999999998},{"interface":"front","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.64500000000000002,"15min":0.57999999999999996},"max":{"1min":1.5389999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.80800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509815,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":8744960,"data_stored":8529659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88100000000000001,"15min":0.88500000000000001},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1990000000000001,"5min":1.3109999999999999,"15min":2.04},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3089999999999999,"5min":1.4399999999999999,"15min":2.1970000000000001},"last":1.032},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.51500000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.6309999999999998},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.51300000000000001},"max":{"1min":1.3879999999999999,"5min":1.6279999999999999,"15min":2.7810000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64000000000000001,"5min":0.55100000000000005,"15min":0.504},"max":{"1min":1.5640000000000001,"5min":1.7,"15min":1.7},"last":1.1279999999999999}]},{"osd":3,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.008,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":2.4820000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.069,"15min":1.083},"min":{"1min":0.84399999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.339,"5min":1.5369999999999999,"15min":2.4399999999999999},"last":1.2829999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.46000000000000002},"max":{"1min":1.484,"5min":1.5149999999999999,"15min":1.9119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.034,"15min":1.054},"min":{"1min":0.70799999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":2.7160000000000002},"last":1.077}]},{"osd":6,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.115,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.474,"5min":1.502,"15min":2.3650000000000002},"last":1.355},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.095,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7549999999999999},"last":1.25}]},{"osd":7,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1080000000000001,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.601,"5min":1.601,"15min":3.1720000000000002},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.49,"5min":1.718,"15min":2.8999999999999999},"last":1.169}]}]},{"osd":3,"up_from":15,"seq":64424509816,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":11600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":11878400,"data_stored":11653269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.33600000000000002},"max":{"1min":1.0009999999999999,"5min":1.47,"15min":1.47},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.71699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.30599999999999999},"max":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.3109999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.33400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3069999999999999,"15min":1.4339999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85199999999999998,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.42499999999999999,"15min":0.36199999999999999},"max":{"1min":1.153,"5min":1.444,"15min":1.444},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.47599999999999998,"15min":0.376},"max":{"1min":1.397,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.88500000000000001},"min":{"1min":0.51300000000000001,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4870000000000001,"5min":1.5369999999999999,"15min":1.5680000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.5049999999999999,"15min":1.5580000000000001},"last":0.879},{"interface":"front","average":{"1min":1.071,"5min":1.103,"15min":1.075},"min":{"1min":0.78100000000000003,"5min":0.65100000000000002,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.0920000000000001},"min":{"1min":0.68700000000000006,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.728,"15min":1.728},"last":1.081},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.0580000000000001},"min":{"1min":0.74399999999999999,"5min":0.621,"15min":0.60299999999999998},"max":{"1min":1.6459999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0940000000000001,"15min":1.0649999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.56200000000000006},"max":{"1min":1.3939999999999999,"5min":1.569,"15min":1.734},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.165},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.004}]},{"osd":7,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1180000000000001},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.60999999999999999},"max":{"1min":1.5700000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.163,"15min":1.1240000000000001},"min":{"1min":0.93200000000000005,"5min":0.78300000000000003,"15min":0.69999999999999996},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.8340000000000001},"last":1.036}]}]},{"osd":7,"up_from":14,"seq":60129542520,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48564,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323276,"statfs":{"total":96636764160,"available":96587034624,"internally_reserved":0,"allocated":13545472,"data_stored":13315101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.372},"max":{"1min":1.212,"5min":1.577,"15min":1.577},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.65500000000000003,"5min":0.51100000000000001,"15min":0.47699999999999998},"max":{"1min":1.2150000000000001,"5min":1.294,"15min":1.4430000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.65300000000000002,"5min":0.55900000000000005,"15min":0.48899999999999999},"max":{"1min":1.22,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.94499999999999995,"15min":0.92000000000000004},"min":{"1min":0.73499999999999999,"5min":0.55100000000000005,"15min":0.48399999999999999},"max":{"1min":1.2889999999999999,"5min":1.3560000000000001,"15min":1.7549999999999999},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0069999999999999,"15min":0.999},"min":{"1min":0.67900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.325,"5min":1.4390000000000001,"15min":1.6319999999999999},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.04,"15min":1.0169999999999999},"min":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3240000000000001,"5min":1.5009999999999999,"15min":1.542},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.70899999999999996,"5min":0.51100000000000001,"15min":0.46500000000000002},"max":{"1min":1.1679999999999999,"5min":1.758,"15min":1.758},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40799999999999997},"max":{"1min":1.395,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.099},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0249999999999999,"15min":1.0549999999999999},"min":{"1min":0.70799999999999996,"5min":0.53500000000000003,"15min":0.40600000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6339999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0580000000000001,"15min":1.0549999999999999},"min":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.622},"max":{"1min":1.367,"5min":1.51,"15min":1.9259999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.087,"15min":1.093},"min":{"1min":0.626,"5min":0.61099999999999999,"15min":0.432},"max":{"1min":1.298,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.1359999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.45600000000000002},"max":{"1min":1.4550000000000001,"5min":1.4710000000000001,"15min":1.8480000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.67600000000000005},"max":{"1min":1.4219999999999999,"5min":1.5680000000000001,"15min":1.75},"last":1.284}]}]},{"osd":0,"up_from":14,"seq":60129542520,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34972,"kb_used_data":7956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336868,"statfs":{"total":96636764160,"available":96600952832,"internally_reserved":0,"allocated":8146944,"data_stored":7918997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.69199999999999995,"15min":0.68300000000000005},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.29099999999999998},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":2.1629999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.42299999999999999,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.89700000000000002}]},{"osd":2,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.78100000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.317},"max":{"1min":1.216,"5min":1.861,"15min":1.861},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":1.3500000000000001,"5min":1.4770000000000001,"15min":2.2490000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.82799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.248},"max":{"1min":1.3140000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36399999999999999,"15min":0.32600000000000001},"max":{"1min":1.7050000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.2130000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0249999999999999,"15min":1.0029999999999999},"min":{"1min":0.72199999999999998,"5min":0.56299999999999994,"15min":0.502},"max":{"1min":1.901,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0660000000000001,"15min":1.0589999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.3330000000000002},"last":1.161}]},{"osd":5,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1040000000000001,"15min":1.109},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.46800000000000003},"max":{"1min":1.514,"5min":1.909,"15min":1.909},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.651,"5min":2.0840000000000001,"15min":2.1150000000000002},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1499999999999999,"15min":1.1299999999999999},"min":{"1min":0.73999999999999999,"5min":0.66600000000000004,"15min":0.61299999999999999},"max":{"1min":1.998,"5min":1.998,"15min":2.4500000000000002},"last":1.274},{"interface":"front","average":{"1min":1.202,"5min":1.1659999999999999,"15min":1.155},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.60799999999999998},"max":{"1min":1.591,"5min":1.831,"15min":1.964},"last":1.302}]},{"osd":7,"last update":"Fri Jan 19 05:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.1970000000000001,"15min":1.1839999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.61399999999999999},"max":{"1min":1.589,"5min":1.968,"15min":1.968},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2310000000000001,"15min":1.1890000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.845,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":7189489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":131176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11546624,"data_stored":11514129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:01:49.978 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:01:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 Processor -- start 2024-01-19T05:01:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 -- start start 2024-01-19T05:01:50.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24200bffd0 0x7f2420159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24200cb750 0x7f242015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24200722a0 con 0x7f24200cb370 2024-01-19T05:01:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2420072580 con 0x7f24200bffd0 2024-01-19T05:01:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f2427416640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2420072860 con 0x7f24200cb750 2024-01-19T05:01:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f24249b1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24200bffd0 0x7f2420159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f24259b3640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24200cb750 0x7f242015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:50.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f24249b1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24200bffd0 0x7f2420159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33744/0 (socket says 172.21.15.133:33744) 2024-01-19T05:01:50.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.134+0000 7f24249b1640 1 -- 172.21.15.133:0/1218348617 learned_addr learned my addr 172.21.15.133:0/1218348617 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.138+0000 7f24249b1640 1 -- 172.21.15.133:0/1218348617 >> v2:172.21.15.156:3300/0 conn(0x7f24200cb750 msgr2=0x7f242015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.138+0000 7f24249b1640 1 --2- 172.21.15.133:0/1218348617 >> v2:172.21.15.156:3300/0 conn(0x7f24200cb750 0x7f242015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.138+0000 7f24249b1640 1 -- 172.21.15.133:0/1218348617 >> v1:172.21.15.156:6789/0 conn(0x7f24200cb370 legacy=0x7f2420071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.138+0000 7f24249b1640 1 -- 172.21.15.133:0/1218348617 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420072b40 con 0x7f24200bffd0 2024-01-19T05:01:50.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.142+0000 7f24249b1640 1 --2- 172.21.15.133:0/1218348617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200bffd0 0x7f2420159f00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2410009870 tx=0x7f241001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456713ceceefb2fa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2417fff640 1 -- 172.21.15.133:0/1218348617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100a89b0 con 0x7f24200bffd0 2024-01-19T05:01:50.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2417fff640 1 -- 172.21.15.133:0/1218348617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100a8b10 con 0x7f24200bffd0 2024-01-19T05:01:50.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2417fff640 1 -- 172.21.15.133:0/1218348617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100a8ea0 con 0x7f24200bffd0 2024-01-19T05:01:50.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 -- 172.21.15.133:0/1218348617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200bffd0 msgr2=0x7f2420159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:50.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 --2- 172.21.15.133:0/1218348617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200bffd0 0x7f2420159f00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2410009870 tx=0x7f241001ecb0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 -- 172.21.15.133:0/1218348617 shutdown_connections 2024-01-19T05:01:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 --2- 172.21.15.133:0/1218348617 >> v2:172.21.15.156:3300/0 conn(0x7f24200cb750 0x7f242015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 --2- 172.21.15.133:0/1218348617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200bffd0 0x7f2420159f00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 -- 172.21.15.133:0/1218348617 >> 172.21.15.133:0/1218348617 conn(0x7f242006d590 msgr2=0x7f2420066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 -- 172.21.15.133:0/1218348617 shutdown_connections 2024-01-19T05:01:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.146+0000 7f2427416640 1 -- 172.21.15.133:0/1218348617 wait complete. 2024-01-19T05:01:50.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 Processor -- start 2024-01-19T05:01:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 -- start start 2024-01-19T05:01:50.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bffd0 0x7f2420153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 0x7f24201eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200cb750 0x7f2420144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420157a00 con 0x7f24200cb370 2024-01-19T05:01:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420157ce0 con 0x7f24200cb750 2024-01-19T05:01:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f2427416640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24201f2210 con 0x7f24200bffd0 2024-01-19T05:01:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f24249b1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 0x7f24201eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:50.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f24249b1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 0x7f24201eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33756/0 (socket says 172.21.15.133:33756) 2024-01-19T05:01:50.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f24249b1640 1 -- 172.21.15.133:0/1060234674 learned_addr learned my addr 172.21.15.133:0/1060234674 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:50.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f24259b3640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200cb750 0x7f2420144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:50.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.150+0000 7f24251b2640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bffd0 0x7f2420153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:50.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.154+0000 7f24249b1640 1 -- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bffd0 msgr2=0x7f2420153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:50.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.154+0000 7f24249b1640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bffd0 0x7f2420153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.154+0000 7f24249b1640 1 -- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200cb750 msgr2=0x7f2420144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:50.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.154+0000 7f24249b1640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200cb750 0x7f2420144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.154+0000 7f24249b1640 1 -- 172.21.15.133:0/1060234674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100094d0 con 0x7f24200cb370 2024-01-19T05:01:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.158+0000 7f24249b1640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 0x7f24201eeca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f24100b3040 tx=0x7f241001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.162+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100b0e10 con 0x7f24200cb370 2024-01-19T05:01:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.162+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100bb480 con 0x7f24200cb370 2024-01-19T05:01:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.162+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100bb830 con 0x7f24200cb370 2024-01-19T05:01:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.162+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24201f24f0 con 0x7f24200cb370 2024-01-19T05:01:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.162+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24201f2ab0 con 0x7f24200cb370 2024-01-19T05:01:50.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.162+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24201f2ca0 con 0x7f24200cb370 2024-01-19T05:01:50.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.182+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f24100bb990 con 0x7f24200cb370 2024-01-19T05:01:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.186+0000 7f2415ffb640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2404066580 0x7f2404068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.186+0000 7f24251b2640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2404066580 0x7f2404068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.186+0000 7f24251b2640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2404066580 0x7f2404068a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f241c007fd0 tx=0x7f241c007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.190+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f24100f3dc0 con 0x7f24200cb370 2024-01-19T05:01:50.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.470+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f24100f0100 con 0x7f24200cb370 2024-01-19T05:01:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.654+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24201f2ca0 con 0x7f24200cb370 2024-01-19T05:01:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.742+0000 7f2415ffb640 1 -- 172.21.15.133:0/1060234674 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18782 (secure 0 0 0) 0x7f24100b5070 con 0x7f24200cb370 2024-01-19T05:01:50.743 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:01:50.743 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":31,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:32:36.898530+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2404066580 msgr2=0x7f2404068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2404066580 0x7f2404068a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f241c007fd0 tx=0x7f241c007e40 comp rx=0 tx=0).stop 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 msgr2=0x7f24201eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 0x7f24201eeca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f24100b3040 tx=0x7f241001ba50 comp rx=0 tx=0).stop 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 shutdown_connections 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f2404066580 0x7f2404068a40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200cb750 0x7f2420144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24200cb370 0x7f24201eeca0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 --2- 172.21.15.133:0/1060234674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bffd0 0x7f2420153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:50.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 >> 172.21.15.133:0/1060234674 conn(0x7f242006d590 msgr2=0x7f2420071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:50.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 shutdown_connections 2024-01-19T05:01:50.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:50.746+0000 7f2427416640 1 -- 172.21.15.133:0/1060234674 wait complete. 2024-01-19T05:01:51.772 INFO:tasks.ceph:Scrubbing osd.0 2024-01-19T05:01:51.772 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 Processor -- start 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 -- start start 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77a40bffd0 0x7f77a4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb750 0x7f77a415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a40722a0 con 0x7f77a40cb370 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a4072580 con 0x7f77a40bffd0 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.910+0000 7f77a995a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4072860 con 0x7f77a40cb750 2024-01-19T05:01:51.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.914+0000 7f77a27fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77a40bffd0 0x7f77a4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.914+0000 7f77a2ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f77a40cb370 0x7f77a4071a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45332/0 (socket says 172.21.15.133:45332) 2024-01-19T05:01:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.914+0000 7f77a2ffd640 1 -- 172.21.15.133:0/3886794786 learned_addr learned my addr 172.21.15.133:0/3886794786 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.914+0000 7f77a37fe640 1 --2- 172.21.15.133:0/3886794786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb750 0x7f77a415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.918+0000 7f77a27fc640 1 -- 172.21.15.133:0/3886794786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb750 msgr2=0x7f77a415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.918+0000 7f77a27fc640 1 --2- 172.21.15.133:0/3886794786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb750 0x7f77a415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.918+0000 7f77a27fc640 1 -- 172.21.15.133:0/3886794786 >> v1:172.21.15.133:6789/0 conn(0x7f77a40cb370 legacy=0x7f77a4071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.918+0000 7f77a27fc640 1 -- 172.21.15.133:0/3886794786 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4072b40 con 0x7f77a40bffd0 2024-01-19T05:01:51.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.922+0000 7f77a27fc640 1 --2- 172.21.15.133:0/3886794786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a4159f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77980097f0 tx=0x7f779801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c7acf20539828c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a1ffb640 1 -- 172.21.15.133:0/3886794786 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980a8970 con 0x7f77a40bffd0 2024-01-19T05:01:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a1ffb640 1 -- 172.21.15.133:0/3886794786 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77980a8ad0 con 0x7f77a40bffd0 2024-01-19T05:01:51.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a1ffb640 1 -- 172.21.15.133:0/3886794786 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980a8e60 con 0x7f77a40bffd0 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 -- 172.21.15.133:0/3886794786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 msgr2=0x7f77a4159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 --2- 172.21.15.133:0/3886794786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a4159f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77980097f0 tx=0x7f779801ec70 comp rx=0 tx=0).stop 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 -- 172.21.15.133:0/3886794786 shutdown_connections 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 --2- 172.21.15.133:0/3886794786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb750 0x7f77a415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 --2- 172.21.15.133:0/3886794786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a4159f00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 -- 172.21.15.133:0/3886794786 >> 172.21.15.133:0/3886794786 conn(0x7f77a406d590 msgr2=0x7f77a4066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 -- 172.21.15.133:0/3886794786 shutdown_connections 2024-01-19T05:01:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.926+0000 7f77a995a640 1 -- 172.21.15.133:0/3886794786 wait complete. 2024-01-19T05:01:51.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 Processor -- start 2024-01-19T05:01:51.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 -- start start 2024-01-19T05:01:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a41ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb370 0x7f77a41511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77a40cb750 0x7f77a40c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a41efdb0 con 0x7f77a40bffd0 2024-01-19T05:01:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4152100 con 0x7f77a40cb750 2024-01-19T05:01:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a995a640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40c5220 con 0x7f77a40cb370 2024-01-19T05:01:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a41ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a41ef870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33774/0 (socket says 172.21.15.133:33774) 2024-01-19T05:01:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a2ffd640 1 -- 172.21.15.133:0/1056175553 learned_addr learned my addr 172.21.15.133:0/1056175553 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a27fc640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb370 0x7f77a41511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.930+0000 7f77a37fe640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77a40cb750 0x7f77a40c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.934+0000 7f77a2ffd640 1 -- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb370 msgr2=0x7f77a41511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.934+0000 7f77a2ffd640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a40cb370 0x7f77a41511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.934+0000 7f77a2ffd640 1 -- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77a40cb750 msgr2=0x7f77a40c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.934+0000 7f77a2ffd640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77a40cb750 0x7f77a40c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.934+0000 7f77a2ffd640 1 -- 172.21.15.133:0/1056175553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798009420 con 0x7f77a40bffd0 2024-01-19T05:01:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.938+0000 7f77a2ffd640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a41ef870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f779400c420 tx=0x7f779400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.942+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794005cf0 con 0x7f77a40bffd0 2024-01-19T05:01:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.942+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794005e50 con 0x7f77a40bffd0 2024-01-19T05:01:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.942+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40c3ff0 con 0x7f77a40bffd0 2024-01-19T05:01:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.942+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940072f0 con 0x7f77a40bffd0 2024-01-19T05:01:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.942+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a414da70 con 0x7f77a40bffd0 2024-01-19T05:01:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.942+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77a414d8d0 con 0x7f77a40bffd0 2024-01-19T05:01:51.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.962+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7794007450 con 0x7f77a40bffd0 2024-01-19T05:01:51.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.962+0000 7f778bfff640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7790066500 0x7f77900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f77a27fc640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7790066500 0x7f77900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f77a27fc640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7790066500 0x7f77900689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77980b2000 tx=0x7f7798008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:51.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7794054af0 con 0x7f77a40bffd0 2024-01-19T05:01:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f778bfff640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f779006fd60 0x7f7790072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 --> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77900728d0 con 0x7f779006fd60 2024-01-19T05:01:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7794050e30 con 0x7f77a40bffd0 2024-01-19T05:01:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f77a37fe640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f779006fd60 0x7f7790072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f77a37fe640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f779006fd60 0x7f7790072200 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.966+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== osd.0 v2:172.21.15.133:6800/1465777875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f77900728d0 con 0x7f779006fd60 2024-01-19T05:01:51.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 --> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77a4152240 con 0x7f779006fd60 2024-01-19T05:01:51.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f778bfff640 1 -- 172.21.15.133:0/1056175553 <== osd.0 v2:172.21.15.133:6800/1465777875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f779c00f040 con 0x7f779006fd60 2024-01-19T05:01:51.981 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:51.981 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:51.981 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f779006fd60 msgr2=0x7f7790072200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:6800/1465777875,v1:172.21.15.133:6801/1465777875] conn(0x7f779006fd60 0x7f7790072200 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7790066500 msgr2=0x7f77900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7790066500 0x7f77900689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77980b2000 tx=0x7f7798008040 comp rx=0 tx=0).stop 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 msgr2=0x7f77a41ef870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 --2- 172.21.15.133:0/1056175553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a40bffd0 0x7f77a41ef870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f779400c420 tx=0x7f779400c8e0 comp rx=0 tx=0).stop 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a37fe640 1 -- 172.21.15.133:0/1056175553 reap_dead start 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 shutdown_connections 2024-01-19T05:01:51.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 >> 172.21.15.133:0/1056175553 conn(0x7f77a406d590 msgr2=0x7f77a414e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:51.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 shutdown_connections 2024-01-19T05:01:51.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:51.982+0000 7f77a995a640 1 -- 172.21.15.133:0/1056175553 wait complete. 2024-01-19T05:01:52.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-19T05:01:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.118+0000 7f74acd7b640 1 Processor -- start 2024-01-19T05:01:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.118+0000 7f74acd7b640 1 -- start start 2024-01-19T05:01:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.118+0000 7f74acd7b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f74a80707c0 0x7f74a806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.118+0000 7f74acd7b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a806a660 con 0x7f74a80c78d0 2024-01-19T05:01:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.118+0000 7f74acd7b640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a815a9f0 con 0x7f74a81517b0 2024-01-19T05:01:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.118+0000 7f74acd7b640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8151b90 con 0x7f74a80707c0 2024-01-19T05:01:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.122+0000 7f74a6d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74a80c78d0 0x7f74a8161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44776/0 (socket says 172.21.15.133:44776) 2024-01-19T05:01:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.122+0000 7f74a6d9d640 1 -- 172.21.15.133:0/2868127254 learned_addr learned my addr 172.21.15.133:0/2868127254 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.122+0000 7f74a5d9b640 1 --2- 172.21.15.133:0/2868127254 >> v2:172.21.15.156:3300/0 conn(0x7f74a80707c0 0x7f74a806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.122+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518054209 0 0) 0x7f74a806a660 con 0x7f74a80c78d0 2024-01-19T05:01:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.122+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003530 con 0x7f74a80c78d0 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121285849 0 0) 0x7f7494003530 con 0x7f74a80c78d0 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 >> v2:172.21.15.156:3300/0 conn(0x7f74a80707c0 msgr2=0x7f74a806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 --2- 172.21.15.133:0/2868127254 >> v2:172.21.15.156:3300/0 conn(0x7f74a80707c0 0x7f74a806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 >> v1:172.21.15.156:6789/0 conn(0x7f74a81517b0 legacy=0x7f74a815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a815acd0 con 0x7f74a80c78d0 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f74a0001a00 con 0x7f74a80c78d0 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 >> v1:172.21.15.133:6789/0 conn(0x7f74a80c78d0 legacy=0x7f74a8161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7494003a40 0x7f7494003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74940047d0 0x7f7494004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f749400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8151b90 con 0x7f74940052b0 2024-01-19T05:01:52.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749400c180 con 0x7f7494003a40 2024-01-19T05:01:52.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749400c340 con 0x7f74940047d0 2024-01-19T05:01:52.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.126+0000 7f74a5d9b640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74940047d0 0x7f7494004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.130+0000 7f74a6d9d640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f749400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 -- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74940047d0 msgr2=0x7f7494004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:52.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74940047d0 0x7f7494004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 -- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7494003a40 msgr2=0x7f7494003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:52.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7494003a40 0x7f7494003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 -- 172.21.15.133:0/2868127254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494003530 con 0x7f74940052b0 2024-01-19T05:01:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 -- 172.21.15.133:0/2868127254 reap_dead start 2024-01-19T05:01:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.134+0000 7f74a6d9d640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f749400b990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f74a000a740 tx=0x7f74a001f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecc7c910adad7ce server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.138+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00ac650 con 0x7f74940052b0 2024-01-19T05:01:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.138+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00ac7b0 con 0x7f74940052b0 2024-01-19T05:01:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.138+0000 7f74a559a640 1 -- 172.21.15.133:0/2868127254 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00acb60 con 0x7f74940052b0 2024-01-19T05:01:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- 172.21.15.133:0/2868127254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 msgr2=0x7f749400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f749400b990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f74a000a740 tx=0x7f74a001f9a0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- 172.21.15.133:0/2868127254 shutdown_connections 2024-01-19T05:01:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 --2- 172.21.15.133:0/2868127254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f749400b990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- 172.21.15.133:0/2868127254 >> 172.21.15.133:0/2868127254 conn(0x7f74a8072450 msgr2=0x7f74a806fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:52.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- 172.21.15.133:0/2868127254 shutdown_connections 2024-01-19T05:01:52.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- 172.21.15.133:0/2868127254 wait complete. 2024-01-19T05:01:52.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 Processor -- start 2024-01-19T05:01:52.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- start start 2024-01-19T05:01:52.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f74a80c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a81f2fc0 0x7f74a80c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80c4b20 0x7f74a80c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c5c10 con 0x7f74940052b0 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81f3400 con 0x7f74a80c4b20 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74acd7b640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81f2520 con 0x7f74a81f2fc0 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74a659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f74a80c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74a659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f74a80c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60500/0 (socket says 172.21.15.133:60500) 2024-01-19T05:01:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.142+0000 7f74a659c640 1 -- 172.21.15.133:0/690188299 learned_addr learned my addr 172.21.15.133:0/690188299 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:52.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a6d9d640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80c4b20 0x7f74a80c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a5d9b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a81f2fc0 0x7f74a80c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a659c640 1 -- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a81f2fc0 msgr2=0x7f74a80c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a659c640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a81f2fc0 0x7f74a80c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a659c640 1 -- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80c4b20 msgr2=0x7f74a80c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a659c640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80c4b20 0x7f74a80c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.146+0000 7f74a659c640 1 -- 172.21.15.133:0/690188299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80c3950 con 0x7f74940052b0 2024-01-19T05:01:52.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.150+0000 7f74a659c640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f74a80c4370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f749000c3c0 tx=0x7f749000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:52.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.154+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490011790 con 0x7f74940052b0 2024-01-19T05:01:52.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.154+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900118f0 con 0x7f74940052b0 2024-01-19T05:01:52.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.154+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a80c3c30 con 0x7f74940052b0 2024-01-19T05:01:52.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.154+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490011ca0 con 0x7f74940052b0 2024-01-19T05:01:52.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.154+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a81f27c0 con 0x7f74940052b0 2024-01-19T05:01:52.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.154+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a8074340 con 0x7f74940052b0 2024-01-19T05:01:52.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.174+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f749001c460 con 0x7f74940052b0 2024-01-19T05:01:52.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.178+0000 7f749effd640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7488066580 0x7f7488068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.178+0000 7f74a5d9b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7488066580 0x7f7488068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.178+0000 7f74a5d9b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7488066580 0x7f7488068a40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74a81587a0 tx=0x7f7498008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.446+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7490055de0 con 0x7f74940052b0 2024-01-19T05:01:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.446+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7490051a20 con 0x7f74940052b0 2024-01-19T05:01:52.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.622+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a80c7d20 con 0x7f7488066580 2024-01-19T05:01:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.622+0000 7f749effd640 1 -- 172.21.15.133:0/690188299 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f74a80c7d20 con 0x7f7488066580 2024-01-19T05:01:52.623 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7488066580 msgr2=0x7f7488068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7488066580 0x7f7488068a40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74a81587a0 tx=0x7f7498008040 comp rx=0 tx=0).stop 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 msgr2=0x7f74a80c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f74a80c4370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f749000c3c0 tx=0x7f749000c880 comp rx=0 tx=0).stop 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 shutdown_connections 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7488066580 0x7f7488068a40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80c4b20 0x7f74a80c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a81f2fc0 0x7f74a80c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 --2- 172.21.15.133:0/690188299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940052b0 0x7f74a80c4370 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 >> 172.21.15.133:0/690188299 conn(0x7f74a8072450 msgr2=0x7f74a8157470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:52.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 shutdown_connections 2024-01-19T05:01:52.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.626+0000 7f74acd7b640 1 -- 172.21.15.133:0/690188299 wait complete. 2024-01-19T05:01:52.643 INFO:tasks.ceph:Scrubbing osd.1 2024-01-19T05:01:52.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 Processor -- start 2024-01-19T05:01:52.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 -- start start 2024-01-19T05:01:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d780bffd0 0x7f1d78159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d780cb750 0x7f1d7815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780722a0 con 0x7f1d780cb370 2024-01-19T05:01:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d78072580 con 0x7f1d780cb750 2024-01-19T05:01:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d804a6640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d78072860 con 0x7f1d780bffd0 2024-01-19T05:01:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.770+0000 7f1d7ea43640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d780cb750 0x7f1d7815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.774+0000 7f1d7e242640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d780cb370 0x7f1d78071a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44778/0 (socket says 172.21.15.133:44778) 2024-01-19T05:01:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.774+0000 7f1d7e242640 1 -- 172.21.15.133:0/3446842427 learned_addr learned my addr 172.21.15.133:0/3446842427 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.778+0000 7f1d7ea43640 1 -- 172.21.15.133:0/3446842427 >> v2:172.21.15.156:3300/0 conn(0x7f1d780bffd0 msgr2=0x7f1d78159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.778+0000 7f1d7ea43640 1 --2- 172.21.15.133:0/3446842427 >> v2:172.21.15.156:3300/0 conn(0x7f1d780bffd0 0x7f1d78159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.778+0000 7f1d7ea43640 1 -- 172.21.15.133:0/3446842427 >> v1:172.21.15.133:6789/0 conn(0x7f1d780cb370 legacy=0x7f1d78071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.778+0000 7f1d7ea43640 1 -- 172.21.15.133:0/3446842427 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78072b40 con 0x7f1d780cb750 2024-01-19T05:01:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.790+0000 7f1d7ea43640 1 --2- 172.21.15.133:0/3446842427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780cb750 0x7f1d7815a440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009d90 tx=0x7f1d7001f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ca35b499f0a6cb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d7d240640 1 -- 172.21.15.133:0/3446842427 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d700af600 con 0x7f1d780cb750 2024-01-19T05:01:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d7d240640 1 -- 172.21.15.133:0/3446842427 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d700ab050 con 0x7f1d780cb750 2024-01-19T05:01:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d7d240640 1 -- 172.21.15.133:0/3446842427 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d700af980 con 0x7f1d780cb750 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 -- 172.21.15.133:0/3446842427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780cb750 msgr2=0x7f1d7815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 --2- 172.21.15.133:0/3446842427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780cb750 0x7f1d7815a440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009d90 tx=0x7f1d7001f100 comp rx=0 tx=0).stop 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 -- 172.21.15.133:0/3446842427 shutdown_connections 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 --2- 172.21.15.133:0/3446842427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780cb750 0x7f1d7815a440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 --2- 172.21.15.133:0/3446842427 >> v2:172.21.15.156:3300/0 conn(0x7f1d780bffd0 0x7f1d78159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 -- 172.21.15.133:0/3446842427 >> 172.21.15.133:0/3446842427 conn(0x7f1d7806d590 msgr2=0x7f1d78066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 -- 172.21.15.133:0/3446842427 shutdown_connections 2024-01-19T05:01:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 -- 172.21.15.133:0/3446842427 wait complete. 2024-01-19T05:01:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 Processor -- start 2024-01-19T05:01:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.802+0000 7f1d804a6640 1 -- start start 2024-01-19T05:01:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d804a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780bffd0 0x7f1d78147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d804a6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d780cb370 0x7f1d78147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d804a6640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d780cb750 0x7f1d780acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d804a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78158450 con 0x7f1d780bffd0 2024-01-19T05:01:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d804a6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780af770 con 0x7f1d780cb370 2024-01-19T05:01:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d804a6640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78158f00 con 0x7f1d780cb750 2024-01-19T05:01:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d7da41640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d780cb370 0x7f1d78147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d7ea43640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d780cb750 0x7f1d780acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d7da41640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d780cb370 0x7f1d78147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:33058/0 (socket says 172.21.15.133:33058) 2024-01-19T05:01:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.806+0000 7f1d7da41640 1 -- 172.21.15.133:0/2881986047 learned_addr learned my addr 172.21.15.133:0/2881986047 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.814+0000 7f1d7da41640 1 -- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d780cb750 msgr2=0x7f1d780acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.814+0000 7f1d7da41640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d780cb750 0x7f1d780acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.814+0000 7f1d7da41640 1 -- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780bffd0 msgr2=0x7f1d78147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.814+0000 7f1d7da41640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d780bffd0 0x7f1d78147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.814+0000 7f1d7da41640 1 -- 172.21.15.133:0/2881986047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009a70 con 0x7f1d780cb370 2024-01-19T05:01:52.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.830+0000 7f1d7da41640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d780cb370 0x7f1d78147c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800b550 tx=0x7f1d6800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:52.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.950+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68010870 con 0x7f1d780cb370 2024-01-19T05:01:52.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.950+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680109f0 con 0x7f1d780cb370 2024-01-19T05:01:52.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.950+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780acab0 con 0x7f1d780cb370 2024-01-19T05:01:52.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.950+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68010da0 con 0x7f1d780cb370 2024-01-19T05:01:52.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.950+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d78158940 con 0x7f1d780cb370 2024-01-19T05:01:52.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:52.950+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d780ac880 con 0x7f1d780cb370 2024-01-19T05:01:53.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.010+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1d6800f3c0 con 0x7f1d780cb370 2024-01-19T05:01:53.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.010+0000 7f1d6effd640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1d5c066550 0x7f1d5c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.010+0000 7f1d7e242640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1d5c066550 0x7f1d5c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.014+0000 7f1d7e242640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1d5c066550 0x7f1d5c068a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d74000f70 tx=0x7f1d74007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.018+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d68055350 con 0x7f1d780cb370 2024-01-19T05:01:53.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.018+0000 7f1d6effd640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f1d5c06fdb0 0x7f1d5c072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.018+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 --> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d5c072920 con 0x7f1d5c06fdb0 2024-01-19T05:01:53.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.018+0000 7f1d7ea43640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f1d5c06fdb0 0x7f1d5c072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.018+0000 7f1d7ea43640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f1d5c06fdb0 0x7f1d5c072250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.022+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== osd.1 v2:172.21.15.133:6816/2799296662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1d5c072920 con 0x7f1d5c06fdb0 2024-01-19T05:01:53.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 --> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1d78074340 con 0x7f1d5c06fdb0 2024-01-19T05:01:53.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d6effd640 1 -- 172.21.15.133:0/2881986047 <== osd.1 v2:172.21.15.133:6816/2799296662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1d78074340 con 0x7f1d5c06fdb0 2024-01-19T05:01:53.046 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:53.047 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:53.047 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:53.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f1d5c06fdb0 msgr2=0x7f1d5c072250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.133:6816/2799296662,v1:172.21.15.133:6817/2799296662] conn(0x7f1d5c06fdb0 0x7f1d5c072250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1d5c066550 msgr2=0x7f1d5c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1d5c066550 0x7f1d5c068a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d74000f70 tx=0x7f1d74007a90 comp rx=0 tx=0).stop 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d780cb370 msgr2=0x7f1d78147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 --2- 172.21.15.133:0/2881986047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d780cb370 0x7f1d78147c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800b550 tx=0x7f1d6800ba10 comp rx=0 tx=0).stop 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d7ea43640 1 -- 172.21.15.133:0/2881986047 reap_dead start 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 shutdown_connections 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.046+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 >> 172.21.15.133:0/2881986047 conn(0x7f1d7806d590 msgr2=0x7f1d781e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.050+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 shutdown_connections 2024-01-19T05:01:53.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.050+0000 7f1d804a6640 1 -- 172.21.15.133:0/2881986047 wait complete. 2024-01-19T05:01:53.066 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-19T05:01:53.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9cc0bc640 1 Processor -- start 2024-01-19T05:01:53.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9cc0bc640 1 -- start start 2024-01-19T05:01:53.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9cc0bc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 0x7fd9c40c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9cc0bc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c415a2b0 con 0x7fd9c415da50 2024-01-19T05:01:53.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9cc0bc640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c415a590 con 0x7fd9c40cf280 2024-01-19T05:01:53.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9cc0bc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c415d630 con 0x7fd9c40cf660 2024-01-19T05:01:53.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9ca659640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd9c415da50 0x7fd9c4159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44790/0 (socket says 172.21.15.133:44790) 2024-01-19T05:01:53.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9ca659640 1 -- 172.21.15.133:0/886456063 learned_addr learned my addr 172.21.15.133:0/886456063 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:53.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.194+0000 7fd9c9657640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 0x7fd9c40c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.198+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125725939 0 0) 0x7fd9c415a2b0 con 0x7fd9c415da50 2024-01-19T05:01:53.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.198+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b0003530 con 0x7fd9c415da50 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190387291 0 0) 0x7fd9b0003530 con 0x7fd9c415da50 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 msgr2=0x7fd9c40c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 0x7fd9c40c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 >> v1:172.21.15.156:6789/0 conn(0x7fd9c40cf280 legacy=0x7fd9c40c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c415cf70 con 0x7fd9c415da50 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fd9bc001a00 con 0x7fd9c415da50 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 >> v1:172.21.15.133:6789/0 conn(0x7fd9c415da50 legacy=0x7fd9c4159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0003a20 0x7fd9b0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 0x7fd9b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0004d10 0x7fd9b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c415d630 con 0x7fd9b0004d10 2024-01-19T05:01:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b000bb20 con 0x7fd9b0003a20 2024-01-19T05:01:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.202+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b000bce0 con 0x7fd9c40cf660 2024-01-19T05:01:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.206+0000 7fd9ca659640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0004d10 0x7fd9b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.206+0000 7fd9c9e58640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0003a20 0x7fd9b0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.210+0000 7fd9c9657640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 0x7fd9b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.210+0000 7fd9ca659640 1 -- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 msgr2=0x7fd9b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.210+0000 7fd9ca659640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c40cf660 0x7fd9b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.210+0000 7fd9ca659640 1 -- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0003a20 msgr2=0x7fd9b0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.210+0000 7fd9ca659640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0003a20 0x7fd9b0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.210+0000 7fd9ca659640 1 -- 172.21.15.133:0/886456063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0003530 con 0x7fd9b0004d10 2024-01-19T05:01:53.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.214+0000 7fd9ca659640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0004d10 0x7fd9b0005190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc002240 tx=0x7fd9bc01d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d0de483022c645 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0ad630 con 0x7fd9b0004d10 2024-01-19T05:01:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc0a8070 con 0x7fd9b0004d10 2024-01-19T05:01:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9c8e56640 1 -- 172.21.15.133:0/886456063 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0ada10 con 0x7fd9b0004d10 2024-01-19T05:01:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/886456063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0004d10 msgr2=0x7fd9b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/886456063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9b0004d10 0x7fd9b0005190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc002240 tx=0x7fd9bc01d240 comp rx=0 tx=0).stop 2024-01-19T05:01:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9ca659640 1 -- 172.21.15.133:0/886456063 reap_dead start 2024-01-19T05:01:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/886456063 shutdown_connections 2024-01-19T05:01:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/886456063 >> 172.21.15.133:0/886456063 conn(0x7fd9c408afa0 msgr2=0x7fd9c408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/886456063 shutdown_connections 2024-01-19T05:01:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/886456063 wait complete. 2024-01-19T05:01:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 Processor -- start 2024-01-19T05:01:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- start start 2024-01-19T05:01:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0004d10 0x7fd9c4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 0x7fd9c414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c414e490 0x7fd9c414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41efbc0 con 0x7fd9c40c5860 2024-01-19T05:01:53.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41efe80 con 0x7fd9b0004d10 2024-01-19T05:01:53.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9cc0bc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4154190 con 0x7fd9c414e490 2024-01-19T05:01:53.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.218+0000 7fd9c9657640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 0x7fd9c414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 0x7fd9c414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60532/0 (socket says 172.21.15.133:60532) 2024-01-19T05:01:53.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 -- 172.21.15.133:0/1205218812 learned_addr learned my addr 172.21.15.133:0/1205218812 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:53.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9ca659640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c414e490 0x7fd9c414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9e58640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0004d10 0x7fd9c4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 -- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c414e490 msgr2=0x7fd9c414e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c414e490 0x7fd9c414e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 -- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0004d10 msgr2=0x7fd9c4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0004d10 0x7fd9c4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.222+0000 7fd9c9657640 1 -- 172.21.15.133:0/1205218812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4154470 con 0x7fd9c40c5860 2024-01-19T05:01:53.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.226+0000 7fd9c9657640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 0x7fd9c414f300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40115d0 tx=0x7fd9b4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.230+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b400f8f0 con 0x7fd9c40c5860 2024-01-19T05:01:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.230+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b400fa50 con 0x7fd9c40c5860 2024-01-19T05:01:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.230+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b400fe00 con 0x7fd9c40c5860 2024-01-19T05:01:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.230+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c414fbd0 con 0x7fd9c40c5860 2024-01-19T05:01:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.230+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c4154750 con 0x7fd9c40c5860 2024-01-19T05:01:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.230+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c414fd60 con 0x7fd9c40c5860 2024-01-19T05:01:53.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.510+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd9b4015460 con 0x7fd9c40c5860 2024-01-19T05:01:53.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.510+0000 7fd9ba7fc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd9a8066550 0x7fd9a8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.510+0000 7fd9c9e58640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd9a8066550 0x7fd9a8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.514+0000 7fd9c9e58640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd9a8066550 0x7fd9a8068a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0000c10 tx=0x7fd9c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.546+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd9b4055950 con 0x7fd9c40c5860 2024-01-19T05:01:53.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.546+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd9b4051c90 con 0x7fd9c40c5860 2024-01-19T05:01:53.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.718+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c4154300 con 0x7fd9a8066550 2024-01-19T05:01:53.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.718+0000 7fd9ba7fc640 1 -- 172.21.15.133:0/1205218812 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd9c4154300 con 0x7fd9a8066550 2024-01-19T05:01:53.717 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd9a8066550 msgr2=0x7fd9a8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd9a8066550 0x7fd9a8068a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0000c10 tx=0x7fd9c0009040 comp rx=0 tx=0).stop 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 msgr2=0x7fd9c414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 0x7fd9c414f300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40115d0 tx=0x7fd9b4011a90 comp rx=0 tx=0).stop 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 shutdown_connections 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd9a8066550 0x7fd9a8068a10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9c414e490 0x7fd9c414e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9c40c5860 0x7fd9c414f300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 --2- 172.21.15.133:0/1205218812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9b0004d10 0x7fd9c4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 >> 172.21.15.133:0/1205218812 conn(0x7fd9c408afa0 msgr2=0x7fd9c4151680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 shutdown_connections 2024-01-19T05:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.722+0000 7fd9cc0bc640 1 -- 172.21.15.133:0/1205218812 wait complete. 2024-01-19T05:01:53.737 INFO:tasks.ceph:Scrubbing osd.2 2024-01-19T05:01:53.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 Processor -- start 2024-01-19T05:01:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 -- start start 2024-01-19T05:01:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd42c070e00 0x7fd42c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd42c0711e0 0x7fd42c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c15b500 0x7fd42c157500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0c3850 con 0x7fd42c0711e0 2024-01-19T05:01:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c15aaf0 con 0x7fd42c070e00 2024-01-19T05:01:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd432cee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c15b070 con 0x7fd42c15b500 2024-01-19T05:01:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd42bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd42c0711e0 0x7fd42c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd42bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd42c0711e0 0x7fd42c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60542/0 (socket says 172.21.15.133:60542) 2024-01-19T05:01:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.874+0000 7fd42bfff640 1 -- 172.21.15.133:0/2488735046 learned_addr learned my addr 172.21.15.133:0/2488735046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd43128b640 1 --2- 172.21.15.133:0/2488735046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c15b500 0x7fd42c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd430a8a640 1 --2- 172.21.15.133:0/2488735046 >> v2:172.21.15.156:3300/0 conn(0x7fd42c070e00 0x7fd42c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd42bfff640 1 -- 172.21.15.133:0/2488735046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c15b500 msgr2=0x7fd42c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:53.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd42bfff640 1 --2- 172.21.15.133:0/2488735046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c15b500 0x7fd42c157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd42bfff640 1 -- 172.21.15.133:0/2488735046 >> v2:172.21.15.156:3300/0 conn(0x7fd42c070e00 msgr2=0x7fd42c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:53.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd42bfff640 1 --2- 172.21.15.133:0/2488735046 >> v2:172.21.15.156:3300/0 conn(0x7fd42c070e00 0x7fd42c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.878+0000 7fd42bfff640 1 -- 172.21.15.133:0/2488735046 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c15b950 con 0x7fd42c0711e0 2024-01-19T05:01:53.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.882+0000 7fd42bfff640 1 --2- 172.21.15.133:0/2488735046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c0711e0 0x7fd42c0c7620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0c1cb0 tx=0x7fd41401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ed64685d02f366 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd42b7fe640 1 -- 172.21.15.133:0/2488735046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ab600 con 0x7fd42c0711e0 2024-01-19T05:01:53.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd42b7fe640 1 -- 172.21.15.133:0/2488735046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140a7050 con 0x7fd42c0711e0 2024-01-19T05:01:53.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd42b7fe640 1 -- 172.21.15.133:0/2488735046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ab980 con 0x7fd42c0711e0 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 -- 172.21.15.133:0/2488735046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c0711e0 msgr2=0x7fd42c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 --2- 172.21.15.133:0/2488735046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c0711e0 0x7fd42c0c7620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0c1cb0 tx=0x7fd41401c240 comp rx=0 tx=0).stop 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 -- 172.21.15.133:0/2488735046 shutdown_connections 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 --2- 172.21.15.133:0/2488735046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c15b500 0x7fd42c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 --2- 172.21.15.133:0/2488735046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c0711e0 0x7fd42c0c7620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 --2- 172.21.15.133:0/2488735046 >> v2:172.21.15.156:3300/0 conn(0x7fd42c070e00 0x7fd42c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 -- 172.21.15.133:0/2488735046 >> 172.21.15.133:0/2488735046 conn(0x7fd42c06ef50 msgr2=0x7fd42c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 -- 172.21.15.133:0/2488735046 shutdown_connections 2024-01-19T05:01:53.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.890+0000 7fd432cee640 1 -- 172.21.15.133:0/2488735046 wait complete. 2024-01-19T05:01:53.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 Processor -- start 2024-01-19T05:01:53.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 -- start start 2024-01-19T05:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c070e00 0x7fd42c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c0711e0 0x7fd42c147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c15b500 0x7fd42c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c14e900 con 0x7fd42c15b500 2024-01-19T05:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c150820 con 0x7fd42c070e00 2024-01-19T05:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd432cee640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c1f00e0 con 0x7fd42c0711e0 2024-01-19T05:01:53.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd43128b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c15b500 0x7fd42c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd43128b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c15b500 0x7fd42c1f0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60546/0 (socket says 172.21.15.133:60546) 2024-01-19T05:01:53.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd43128b640 1 -- 172.21.15.133:0/3773706244 learned_addr learned my addr 172.21.15.133:0/3773706244 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:53.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd430a8a640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c070e00 0x7fd42c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.894+0000 7fd42bfff640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c0711e0 0x7fd42c147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.898+0000 7fd43128b640 1 -- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c0711e0 msgr2=0x7fd42c147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.898+0000 7fd43128b640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd42c0711e0 0x7fd42c147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.898+0000 7fd43128b640 1 -- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c070e00 msgr2=0x7fd42c1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.898+0000 7fd43128b640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c070e00 0x7fd42c1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.898+0000 7fd43128b640 1 -- 172.21.15.133:0/3773706244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140094d0 con 0x7fd42c15b500 2024-01-19T05:01:53.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.902+0000 7fd43128b640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c15b500 0x7fd42c1f0810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd42400e960 tx=0x7fd42400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.906+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240096b0 con 0x7fd42c15b500 2024-01-19T05:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.906+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400c9a0 con 0x7fd42c15b500 2024-01-19T05:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.906+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400cd30 con 0x7fd42c15b500 2024-01-19T05:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.906+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c1586c0 con 0x7fd42c15b500 2024-01-19T05:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.906+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c1f0380 con 0x7fd42c15b500 2024-01-19T05:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.906+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd42c157fc0 con 0x7fd42c15b500 2024-01-19T05:01:53.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.930+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd424013470 con 0x7fd42c15b500 2024-01-19T05:01:53.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd4297fa640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd40c066530 0x7fd40c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd430a8a640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd40c066530 0x7fd40c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd430a8a640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd40c066530 0x7fd40c0689f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd41c011200 tx=0x7fd41c00d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd4240553e0 con 0x7fd42c15b500 2024-01-19T05:01:53.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd4297fa640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7fd40c06fd90 0x7fd40c072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:53.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 --> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd40c072900 con 0x7fd40c06fd90 2024-01-19T05:01:53.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd424051720 con 0x7fd42c15b500 2024-01-19T05:01:53.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd42bfff640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7fd40c06fd90 0x7fd40c072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:53.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.934+0000 7fd42bfff640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7fd40c06fd90 0x7fd40c072230 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:53.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.938+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== osd.2 v2:172.21.15.133:6808/2653064077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd40c072900 con 0x7fd40c06fd90 2024-01-19T05:01:53.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 --> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd42c1f0510 con 0x7fd40c06fd90 2024-01-19T05:01:53.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd4297fa640 1 -- 172.21.15.133:0/3773706244 <== osd.2 v2:172.21.15.133:6808/2653064077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd42c1f0510 con 0x7fd40c06fd90 2024-01-19T05:01:53.949 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:53.949 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:53.949 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7fd40c06fd90 msgr2=0x7fd40c072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:6808/2653064077,v1:172.21.15.133:6809/2653064077] conn(0x7fd40c06fd90 0x7fd40c072230 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd40c066530 msgr2=0x7fd40c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd40c066530 0x7fd40c0689f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd41c011200 tx=0x7fd41c00d040 comp rx=0 tx=0).stop 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c15b500 msgr2=0x7fd42c1f0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 --2- 172.21.15.133:0/3773706244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd42c15b500 0x7fd42c1f0810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd42400e960 tx=0x7fd42400ee20 comp rx=0 tx=0).stop 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd43128b640 1 -- 172.21.15.133:0/3773706244 reap_dead start 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 shutdown_connections 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 >> 172.21.15.133:0/3773706244 conn(0x7fd42c06ef50 msgr2=0x7fd42c06f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 shutdown_connections 2024-01-19T05:01:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:53.950+0000 7fd432cee640 1 -- 172.21.15.133:0/3773706244 wait complete. 2024-01-19T05:01:53.968 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-19T05:01:54.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 Processor -- start 2024-01-19T05:01:54.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 -- start start 2024-01-19T05:01:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb084151740 0x7fb084157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb08406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840c7500 con 0x7fb0840c5db0 2024-01-19T05:01:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08406f190 con 0x7fb084151740 2024-01-19T05:01:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb089bbc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084151b20 con 0x7fb0840c7990 2024-01-19T05:01:54.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb0837fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb084151740 0x7fb084157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb0837fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb084151740 0x7fb084157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60550/0 (socket says 172.21.15.133:60550) 2024-01-19T05:01:54.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.086+0000 7fb0837fe640 1 -- 172.21.15.133:0/1592513166 learned_addr learned my addr 172.21.15.133:0/1592513166 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.094+0000 7fb0837fe640 1 -- 172.21.15.133:0/1592513166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 msgr2=0x7fb08406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.094+0000 7fb0837fe640 1 --2- 172.21.15.133:0/1592513166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb08406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.094+0000 7fb0837fe640 1 -- 172.21.15.133:0/1592513166 >> v1:172.21.15.133:6789/0 conn(0x7fb0840c5db0 legacy=0x7fb08406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.094+0000 7fb0837fe640 1 -- 172.21.15.133:0/1592513166 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840c7e40 con 0x7fb084151740 2024-01-19T05:01:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.098+0000 7fb0837fe640 1 --2- 172.21.15.133:0/1592513166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb084157380 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb074009870 tx=0x7fb07401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d355e0400bcc1b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb0827fc640 1 -- 172.21.15.133:0/1592513166 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740a8a30 con 0x7fb084151740 2024-01-19T05:01:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb0827fc640 1 -- 172.21.15.133:0/1592513166 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740a8b90 con 0x7fb084151740 2024-01-19T05:01:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb0827fc640 1 -- 172.21.15.133:0/1592513166 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740b0440 con 0x7fb084151740 2024-01-19T05:01:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 -- 172.21.15.133:0/1592513166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 msgr2=0x7fb084157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1592513166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb084157380 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb074009870 tx=0x7fb07401ed30 comp rx=0 tx=0).stop 2024-01-19T05:01:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 -- 172.21.15.133:0/1592513166 shutdown_connections 2024-01-19T05:01:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1592513166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb08406feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1592513166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb084157380 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 -- 172.21.15.133:0/1592513166 >> 172.21.15.133:0/1592513166 conn(0x7fb08406b770 msgr2=0x7fb08406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:54.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 -- 172.21.15.133:0/1592513166 shutdown_connections 2024-01-19T05:01:54.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 -- 172.21.15.133:0/1592513166 wait complete. 2024-01-19T05:01:54.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 Processor -- start 2024-01-19T05:01:54.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.106+0000 7fb089bbc640 1 -- start start 2024-01-19T05:01:54.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb089bbc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0840c5db0 0x7fb0841dd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb089bbc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb0841f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb089bbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb0841f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb089bbc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841efc30 con 0x7fb084151740 2024-01-19T05:01:54.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb089bbc640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841ef080 con 0x7fb0840c5db0 2024-01-19T05:01:54.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb089bbc640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084156b80 con 0x7fb0840c7990 2024-01-19T05:01:54.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb083fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb0841f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb083fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb0841f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60554/0 (socket says 172.21.15.133:60554) 2024-01-19T05:01:54.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb083fff640 1 -- 172.21.15.133:0/1301429167 learned_addr learned my addr 172.21.15.133:0/1301429167 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:54.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.110+0000 7fb0837fe640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0840c5db0 0x7fb0841dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.114+0000 7fb082ffd640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb0841f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.114+0000 7fb083fff640 1 -- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 msgr2=0x7fb0841f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.114+0000 7fb083fff640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb0841f2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.114+0000 7fb083fff640 1 -- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0840c5db0 msgr2=0x7fb0841dd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.114+0000 7fb083fff640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0840c5db0 0x7fb0841dd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.114+0000 7fb083fff640 1 -- 172.21.15.133:0/1301429167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740094d0 con 0x7fb084151740 2024-01-19T05:01:54.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.118+0000 7fb083fff640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb0841f2b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00b9a0 tx=0x7fb07c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.122+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00cba0 con 0x7fb084151740 2024-01-19T05:01:54.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.122+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00cd20 con 0x7fb084151740 2024-01-19T05:01:54.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.122+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c014680 con 0x7fb084151740 2024-01-19T05:01:54.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.122+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840cabe0 con 0x7fb084151740 2024-01-19T05:01:54.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.122+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0841ef5e0 con 0x7fb084151740 2024-01-19T05:01:54.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.122+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0841efde0 con 0x7fb084151740 2024-01-19T05:01:54.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.142+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb07c01d3b0 con 0x7fb084151740 2024-01-19T05:01:54.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.142+0000 7fb06bfff640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb070066550 0x7fb070068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.142+0000 7fb0837fe640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb070066550 0x7fb070068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.142+0000 7fb0837fe640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb070066550 0x7fb070068a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0740b2000 tx=0x7fb0740aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.146+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb07c055070 con 0x7fb084151740 2024-01-19T05:01:54.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.406+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb07c0513b0 con 0x7fb084151740 2024-01-19T05:01:54.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.562+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0840c9300 con 0x7fb070066550 2024-01-19T05:01:54.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.562+0000 7fb06bfff640 1 -- 172.21.15.133:0/1301429167 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0740b0440 con 0x7fb070066550 2024-01-19T05:01:54.563 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2024-01-19T05:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb070066550 msgr2=0x7fb070068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb070066550 0x7fb070068a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0740b2000 tx=0x7fb0740aa070 comp rx=0 tx=0).stop 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 msgr2=0x7fb0841f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb0841f2b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00b9a0 tx=0x7fb07c00be60 comp rx=0 tx=0).stop 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 shutdown_connections 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb070066550 0x7fb070068a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb084151740 0x7fb0841f2b50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0840c7990 0x7fb0841f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 --2- 172.21.15.133:0/1301429167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0840c5db0 0x7fb0841dd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 >> 172.21.15.133:0/1301429167 conn(0x7fb08406b770 msgr2=0x7fb08406de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 shutdown_connections 2024-01-19T05:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.566+0000 7fb089bbc640 1 -- 172.21.15.133:0/1301429167 wait complete. 2024-01-19T05:01:54.581 INFO:tasks.ceph:Scrubbing osd.3 2024-01-19T05:01:54.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.702+0000 7f603aa6e640 1 Processor -- start 2024-01-19T05:01:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.702+0000 7f603aa6e640 1 -- start start 2024-01-19T05:01:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.702+0000 7f603aa6e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 0x7f603415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.702+0000 7f603aa6e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603415b900 con 0x7f60340c7f70 2024-01-19T05:01:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.702+0000 7f603aa6e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340c8400 con 0x7f60340c7b50 2024-01-19T05:01:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.702+0000 7f603aa6e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6034157790 con 0x7f60341518b0 2024-01-19T05:01:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.706+0000 7f603900b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f60340c7f70 0x7f60340c1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44810/0 (socket says 172.21.15.133:44810) 2024-01-19T05:01:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.706+0000 7f603900b640 1 -- 172.21.15.133:0/2292043423 learned_addr learned my addr 172.21.15.133:0/2292043423 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.706+0000 7f603880a640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 0x7f603415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.706+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75470728 0 0) 0x7f602c0014a0 con 0x7f60340c7f70 2024-01-19T05:01:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.706+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6024003530 con 0x7f60340c7f70 2024-01-19T05:01:54.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575476436 0 0) 0x7f6024003530 con 0x7f60340c7f70 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 msgr2=0x7f603415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 0x7f603415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 >> v1:172.21.15.156:6789/0 conn(0x7f60340c7b50 legacy=0x7f60340c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034157a70 con 0x7f60340c7f70 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7f602c001b90 con 0x7f60340c7f70 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 >> v1:172.21.15.133:6789/0 conn(0x7f60340c7f70 legacy=0x7f60340c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60240039b0 0x7f6024003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f6024004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 0x7f6024005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6034157790 con 0x7f60240047d0 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602400bb00 con 0x7f60240039b0 2024-01-19T05:01:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.710+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602400bcc0 con 0x7f60341518b0 2024-01-19T05:01:54.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.714+0000 7f6033fff640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f6024004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.718+0000 7f6033fff640 1 -- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 msgr2=0x7f6024005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:54.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.718+0000 7f6033fff640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60341518b0 0x7f6024005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.718+0000 7f6033fff640 1 -- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60240039b0 msgr2=0x7f6024003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:54.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.718+0000 7f6033fff640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60240039b0 0x7f6024003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.718+0000 7f6033fff640 1 -- 172.21.15.133:0/2292043423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024003530 con 0x7f60240047d0 2024-01-19T05:01:54.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.722+0000 7f6033fff640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f6024004c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6020001360 tx=0x7f60200207d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f66b05c5ff01b2a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200052d0 con 0x7f60240047d0 2024-01-19T05:01:54.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020005450 con 0x7f60240047d0 2024-01-19T05:01:54.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f60337fe640 1 -- 172.21.15.133:0/2292043423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020003840 con 0x7f60240047d0 2024-01-19T05:01:54.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- 172.21.15.133:0/2292043423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 msgr2=0x7f6024004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 --2- 172.21.15.133:0/2292043423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f6024004c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6020001360 tx=0x7f60200207d0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603900b640 1 -- 172.21.15.133:0/2292043423 reap_dead start 2024-01-19T05:01:54.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- 172.21.15.133:0/2292043423 shutdown_connections 2024-01-19T05:01:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- 172.21.15.133:0/2292043423 >> 172.21.15.133:0/2292043423 conn(0x7f603406a660 msgr2=0x7f603406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- 172.21.15.133:0/2292043423 shutdown_connections 2024-01-19T05:01:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- 172.21.15.133:0/2292043423 wait complete. 2024-01-19T05:01:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 Processor -- start 2024-01-19T05:01:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- start start 2024-01-19T05:01:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f60341eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60340cd810 0x7f603414e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60340cb8b0 0x7f60340c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341ef1e0 con 0x7f60240047d0 2024-01-19T05:01:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341ebc60 con 0x7f60340cd810 2024-01-19T05:01:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603aa6e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60340cb390 con 0x7f60340cb8b0 2024-01-19T05:01:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603880a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f60341eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603880a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f60341eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60566/0 (socket says 172.21.15.133:60566) 2024-01-19T05:01:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.726+0000 7f603880a640 1 -- 172.21.15.133:0/3574446392 learned_addr learned my addr 172.21.15.133:0/3574446392 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f603900b640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60340cb8b0 0x7f60340c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f6033fff640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60340cd810 0x7f603414e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f603880a640 1 -- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60340cb8b0 msgr2=0x7f60340c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f603880a640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60340cb8b0 0x7f60340c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f603880a640 1 -- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60340cd810 msgr2=0x7f603414e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f603880a640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60340cd810 0x7f603414e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.730+0000 7f603880a640 1 -- 172.21.15.133:0/3574446392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340cb0b0 con 0x7f60240047d0 2024-01-19T05:01:54.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.734+0000 7f603880a640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f60341eeca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f602800e7c0 tx=0x7f602800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.738+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800eed0 con 0x7f60240047d0 2024-01-19T05:01:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.738+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800c940 con 0x7f60240047d0 2024-01-19T05:01:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.738+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800ccf0 con 0x7f60240047d0 2024-01-19T05:01:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.738+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60341eaea0 con 0x7f60240047d0 2024-01-19T05:01:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.738+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60341eb460 con 0x7f60240047d0 2024-01-19T05:01:54.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.742+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6034157440 con 0x7f60240047d0 2024-01-19T05:01:54.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.762+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6028013470 con 0x7f60240047d0 2024-01-19T05:01:54.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.762+0000 7f60317fa640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6018066550 0x7f6018068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.762+0000 7f6033fff640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6018066550 0x7f6018068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.766+0000 7f6033fff640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6018066550 0x7f6018068a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f60240057b0 tx=0x7f60200b6040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6028055250 con 0x7f60240047d0 2024-01-19T05:01:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f60317fa640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7f601806fcc0 0x7f6018072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 --> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6018072830 con 0x7f601806fcc0 2024-01-19T05:01:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6028051590 con 0x7f60240047d0 2024-01-19T05:01:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f603900b640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7f601806fcc0 0x7f6018072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f603900b640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7f601806fcc0 0x7f6018072160 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.770+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== osd.3 v2:172.21.15.133:6824/2044063014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6018072830 con 0x7f601806fcc0 2024-01-19T05:01:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 --> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6034158030 con 0x7f601806fcc0 2024-01-19T05:01:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f60317fa640 1 -- 172.21.15.133:0/3574446392 <== osd.3 v2:172.21.15.133:6824/2044063014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f602c004db0 con 0x7f601806fcc0 2024-01-19T05:01:54.784 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:54.784 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7f601806fcc0 msgr2=0x7f6018072160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:6824/2044063014,v1:172.21.15.133:6825/2044063014] conn(0x7f601806fcc0 0x7f6018072160 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6018066550 msgr2=0x7f6018068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6018066550 0x7f6018068a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f60240057b0 tx=0x7f60200b6040 comp rx=0 tx=0).stop 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 msgr2=0x7f60341eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 --2- 172.21.15.133:0/3574446392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60240047d0 0x7f60341eeca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f602800e7c0 tx=0x7f602800ec80 comp rx=0 tx=0).stop 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603900b640 1 -- 172.21.15.133:0/3574446392 reap_dead start 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 shutdown_connections 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 >> 172.21.15.133:0/3574446392 conn(0x7f603406a660 msgr2=0x7f603414ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 shutdown_connections 2024-01-19T05:01:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.786+0000 7f603aa6e640 1 -- 172.21.15.133:0/3574446392 wait complete. 2024-01-19T05:01:54.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-19T05:01:54.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 Processor -- start 2024-01-19T05:01:54.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 -- start start 2024-01-19T05:01:54.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31ec0c7f30 0x7f31ec06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec1518a0 0x7f31ec15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec15a9d0 con 0x7f31ec06dfd0 2024-01-19T05:01:54.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec1573e0 con 0x7f31ec0c7f30 2024-01-19T05:01:54.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31f26a8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec1576a0 con 0x7f31ec1518a0 2024-01-19T05:01:54.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31ebfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31ec0c7f30 0x7f31ec06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.914+0000 7f31ebfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31ec0c7f30 0x7f31ec06da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60574/0 (socket says 172.21.15.133:60574) 2024-01-19T05:01:54.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.918+0000 7f31ebfff640 1 -- 172.21.15.133:0/462756060 learned_addr learned my addr 172.21.15.133:0/462756060 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:54.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.918+0000 7f31f0c45640 1 --2- 172.21.15.133:0/462756060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec1518a0 0x7f31ec15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.918+0000 7f31ebfff640 1 -- 172.21.15.133:0/462756060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec1518a0 msgr2=0x7f31ec15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:54.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.918+0000 7f31ebfff640 1 --2- 172.21.15.133:0/462756060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec1518a0 0x7f31ec15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.918+0000 7f31ebfff640 1 -- 172.21.15.133:0/462756060 >> v1:172.21.15.133:6789/0 conn(0x7f31ec06dfd0 legacy=0x7f31ec151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:54.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.918+0000 7f31ebfff640 1 -- 172.21.15.133:0/462756060 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec157980 con 0x7f31ec0c7f30 2024-01-19T05:01:54.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.922+0000 7f31ebfff640 1 --2- 172.21.15.133:0/462756060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec0c7f30 0x7f31ec06da90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0098a0 tx=0x7f31dc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a53c4aa79fedf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31eaffd640 1 -- 172.21.15.133:0/462756060 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0a8990 con 0x7f31ec0c7f30 2024-01-19T05:01:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31eaffd640 1 -- 172.21.15.133:0/462756060 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc0a8af0 con 0x7f31ec0c7f30 2024-01-19T05:01:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31eaffd640 1 -- 172.21.15.133:0/462756060 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0a8e80 con 0x7f31ec0c7f30 2024-01-19T05:01:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- 172.21.15.133:0/462756060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec0c7f30 msgr2=0x7f31ec06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 --2- 172.21.15.133:0/462756060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec0c7f30 0x7f31ec06da90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0098a0 tx=0x7f31dc01ecd0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- 172.21.15.133:0/462756060 shutdown_connections 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 --2- 172.21.15.133:0/462756060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec1518a0 0x7f31ec15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 --2- 172.21.15.133:0/462756060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec0c7f30 0x7f31ec06da90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- 172.21.15.133:0/462756060 >> 172.21.15.133:0/462756060 conn(0x7f31ec06aa60 msgr2=0x7f31ec06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- 172.21.15.133:0/462756060 shutdown_connections 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- 172.21.15.133:0/462756060 wait complete. 2024-01-19T05:01:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 Processor -- start 2024-01-19T05:01:54.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- start start 2024-01-19T05:01:54.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 0x7f31ec1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec0c7f30 0x7f31ec1ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ec1518a0 0x7f31ec156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec159340 con 0x7f31ec06dfd0 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec15a7c0 con 0x7f31ec1518a0 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.930+0000 7f31f26a8640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec156fc0 con 0x7f31ec0c7f30 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 0x7f31ec1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 0x7f31ec1597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60588/0 (socket says 172.21.15.133:60588) 2024-01-19T05:01:54.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 -- 172.21.15.133:0/1963477386 learned_addr learned my addr 172.21.15.133:0/1963477386 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:54.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31f0c45640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ec1518a0 0x7f31ec156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31eb7fe640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec0c7f30 0x7f31ec1ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 -- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec0c7f30 msgr2=0x7f31ec1ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec0c7f30 0x7f31ec1ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 -- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ec1518a0 msgr2=0x7f31ec156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ec1518a0 0x7f31ec156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.934+0000 7f31ebfff640 1 -- 172.21.15.133:0/1963477386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0094d0 con 0x7f31ec06dfd0 2024-01-19T05:01:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.938+0000 7f31ebfff640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 0x7f31ec1597d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f31dc01c900 tx=0x7f31dc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.942+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0b1d40 con 0x7f31ec06dfd0 2024-01-19T05:01:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.942+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc0bb470 con 0x7f31ec06dfd0 2024-01-19T05:01:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.942+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec159f60 con 0x7f31ec06dfd0 2024-01-19T05:01:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.942+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0b1ea0 con 0x7f31ec06dfd0 2024-01-19T05:01:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.942+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec15a4e0 con 0x7f31ec06dfd0 2024-01-19T05:01:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.942+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec074340 con 0x7f31ec06dfd0 2024-01-19T05:01:54.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.962+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f31dc0b7070 con 0x7f31ec06dfd0 2024-01-19T05:01:54.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.962+0000 7f31e8ff9640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f31d8066500 0x7f31d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:54.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.962+0000 7f31eb7fe640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f31d8066500 0x7f31d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:54.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:54.962+0000 7f31eb7fe640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f31d8066500 0x7f31d80689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31ec071020 tx=0x7f31e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.242+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31dc0f4080 con 0x7f31ec06dfd0 2024-01-19T05:01:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.242+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f31dc0efcc0 con 0x7f31ec06dfd0 2024-01-19T05:01:55.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.409+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f31ec158220 con 0x7f31d8066500 2024-01-19T05:01:55.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31e8ff9640 1 -- 172.21.15.133:0/1963477386 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f31e0005380 con 0x7f31d8066500 2024-01-19T05:01:55.412 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f31d8066500 msgr2=0x7f31d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f31d8066500 0x7f31d80689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31ec071020 tx=0x7f31e0009040 comp rx=0 tx=0).stop 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 msgr2=0x7f31ec1597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 0x7f31ec1597d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f31dc01c900 tx=0x7f31dc01ba70 comp rx=0 tx=0).stop 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 shutdown_connections 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f31d8066500 0x7f31d80689c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ec1518a0 0x7f31ec156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31ec0c7f30 0x7f31ec1ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 --2- 172.21.15.133:0/1963477386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31ec06dfd0 0x7f31ec1597d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 >> 172.21.15.133:0/1963477386 conn(0x7f31ec06aa60 msgr2=0x7f31ec071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:55.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 shutdown_connections 2024-01-19T05:01:55.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.413+0000 7f31f26a8640 1 -- 172.21.15.133:0/1963477386 wait complete. 2024-01-19T05:01:55.432 INFO:tasks.ceph:Scrubbing osd.4 2024-01-19T05:01:55.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:55.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 Processor -- start 2024-01-19T05:01:55.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 -- start start 2024-01-19T05:01:55.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f43b41519e0 0x7f43b415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b40c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b4158390 con 0x7f43b4151600 2024-01-19T05:01:55.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b415b0e0 con 0x7f43b41519e0 2024-01-19T05:01:55.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.565+0000 7f43bb9f5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4157b70 con 0x7f43b406f350 2024-01-19T05:01:55.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.593+0000 7f43b8f90640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f43b41519e0 0x7f43b415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.593+0000 7f43b9f92640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b40c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.593+0000 7f43b9f92640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b40c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:53678/0 (socket says 172.21.15.133:53678) 2024-01-19T05:01:55.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.593+0000 7f43b9f92640 1 -- 172.21.15.133:0/3372175137 learned_addr learned my addr 172.21.15.133:0/3372175137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.597+0000 7f43b8f90640 1 -- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 msgr2=0x7f43b40c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.597+0000 7f43b8f90640 1 --2- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b40c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.597+0000 7f43b8f90640 1 -- 172.21.15.133:0/3372175137 >> v1:172.21.15.156:6789/0 conn(0x7f43b4151600 legacy=0x7f43b4157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.597+0000 7f43b8f90640 1 -- 172.21.15.133:0/3372175137 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4157dd0 con 0x7f43b41519e0 2024-01-19T05:01:55.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.609+0000 7f43b8f90640 1 --2- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b41519e0 0x7f43b415b570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43a40097c0 tx=0x7f43a401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63caf661b4e9d31 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.613+0000 7f43abfff640 1 -- 172.21.15.133:0/3372175137 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ab600 con 0x7f43b41519e0 2024-01-19T05:01:55.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.613+0000 7f43abfff640 1 -- 172.21.15.133:0/3372175137 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40a7050 con 0x7f43b41519e0 2024-01-19T05:01:55.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.613+0000 7f43abfff640 1 -- 172.21.15.133:0/3372175137 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ab980 con 0x7f43b41519e0 2024-01-19T05:01:55.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b41519e0 msgr2=0x7f43b415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 --2- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b41519e0 0x7f43b415b570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43a40097c0 tx=0x7f43a401c3f0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3372175137 shutdown_connections 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 --2- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b40c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 --2- 172.21.15.133:0/3372175137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b41519e0 0x7f43b415b570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3372175137 >> 172.21.15.133:0/3372175137 conn(0x7f43b406d590 msgr2=0x7f43b4066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3372175137 shutdown_connections 2024-01-19T05:01:55.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3372175137 wait complete. 2024-01-19T05:01:55.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 Processor -- start 2024-01-19T05:01:55.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.617+0000 7f43bb9f5640 1 -- start start 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43bb9f5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b41573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43bb9f5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4151600 0x7f43b4159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43bb9f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b40c9e30 0x7f43b40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43bb9f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4157930 con 0x7f43b40c9e30 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43bb9f5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41f5710 con 0x7f43b4151600 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43bb9f5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41f2ba0 con 0x7f43b406f350 2024-01-19T05:01:55.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43b9f92640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b40c9e30 0x7f43b40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43b9f92640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b40c9e30 0x7f43b40ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60604/0 (socket says 172.21.15.133:60604) 2024-01-19T05:01:55.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43b9f92640 1 -- 172.21.15.133:0/3439684824 learned_addr learned my addr 172.21.15.133:0/3439684824 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:55.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43b9791640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b41573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.621+0000 7f43b8f90640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4151600 0x7f43b4159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.625+0000 7f43b9f92640 1 -- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 msgr2=0x7f43b41573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.625+0000 7f43b9f92640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43b406f350 0x7f43b41573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.625+0000 7f43b9f92640 1 -- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4151600 msgr2=0x7f43b4159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.625+0000 7f43b9f92640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4151600 0x7f43b4159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.625+0000 7f43b9f92640 1 -- 172.21.15.133:0/3439684824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009420 con 0x7f43b40c9e30 2024-01-19T05:01:55.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.625+0000 7f43b9f92640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b40c9e30 0x7f43b40ca2e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00efc0 tx=0x7f43ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.633+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac009b60 con 0x7f43b40c9e30 2024-01-19T05:01:55.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.633+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00f040 con 0x7f43b40c9e30 2024-01-19T05:01:55.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.633+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b41f1fb0 con 0x7f43b40c9e30 2024-01-19T05:01:55.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.633+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0039a0 con 0x7f43b40c9e30 2024-01-19T05:01:55.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.633+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b41f2550 con 0x7f43b40c9e30 2024-01-19T05:01:55.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.633+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43b4148220 con 0x7f43b40c9e30 2024-01-19T05:01:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.653+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f43ac003b00 con 0x7f43b40c9e30 2024-01-19T05:01:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.657+0000 7f43a9ffb640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4398066530 0x7f43980689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.657+0000 7f43b9791640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4398066530 0x7f43980689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.657+0000 7f43b9791640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4398066530 0x7f43980689f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43b0001810 tx=0x7f43b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.657+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f43ac056020 con 0x7f43b40c9e30 2024-01-19T05:01:55.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.661+0000 7f43a9ffb640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7f439806fd90 0x7f4398072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.661+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 --> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4398072900 con 0x7f439806fd90 2024-01-19T05:01:55.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.661+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43ac052360 con 0x7f43b40c9e30 2024-01-19T05:01:55.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.661+0000 7f43b8f90640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7f439806fd90 0x7f4398072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.661+0000 7f43b8f90640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7f439806fd90 0x7f4398072230 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.661+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== osd.4 v2:172.21.15.156:6810/3494223144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4398072900 con 0x7f439806fd90 2024-01-19T05:01:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 --> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f43b4072020 con 0x7f439806fd90 2024-01-19T05:01:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43a9ffb640 1 -- 172.21.15.133:0/3439684824 <== osd.4 v2:172.21.15.156:6810/3494223144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f43a40ab680 con 0x7f439806fd90 2024-01-19T05:01:55.681 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:55.681 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:55.681 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7f439806fd90 msgr2=0x7f4398072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6810/3494223144,v1:172.21.15.156:6811/3494223144] conn(0x7f439806fd90 0x7f4398072230 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4398066530 msgr2=0x7f43980689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f4398066530 0x7f43980689f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43b0001810 tx=0x7f43b0009040 comp rx=0 tx=0).stop 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b40c9e30 msgr2=0x7f43b40ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 --2- 172.21.15.133:0/3439684824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43b40c9e30 0x7f43b40ca2e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00efc0 tx=0x7f43ac00c490 comp rx=0 tx=0).stop 2024-01-19T05:01:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43b9f92640 1 -- 172.21.15.133:0/3439684824 reap_dead start 2024-01-19T05:01:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 shutdown_connections 2024-01-19T05:01:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 >> 172.21.15.133:0/3439684824 conn(0x7f43b406d590 msgr2=0x7f43b40c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 shutdown_connections 2024-01-19T05:01:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.681+0000 7f43bb9f5640 1 -- 172.21.15.133:0/3439684824 wait complete. 2024-01-19T05:01:55.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-19T05:01:55.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efeee49d640 1 Processor -- start 2024-01-19T05:01:55.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efeee49d640 1 -- start start 2024-01-19T05:01:55.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efeee49d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efee81516d0 0x7efee80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efeee49d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80c65a0 con 0x7efee80cbde0 2024-01-19T05:01:55.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efeee49d640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee8157650 con 0x7efee81512f0 2024-01-19T05:01:55.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efeee49d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee8158450 con 0x7efee81516d0 2024-01-19T05:01:55.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.829+0000 7efee77fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efee81516d0 0x7efee80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.833+0000 7efee77fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efee81516d0 0x7efee80c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:33150/0 (socket says 172.21.15.133:33150) 2024-01-19T05:01:55.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.833+0000 7efee77fe640 1 -- 172.21.15.133:0/1177612834 learned_addr learned my addr 172.21.15.133:0/1177612834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:55.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.837+0000 7efee77fe640 1 -- 172.21.15.133:0/1177612834 >> v1:172.21.15.156:6789/0 conn(0x7efee81512f0 legacy=0x7efee815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:55.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.837+0000 7efee77fe640 1 -- 172.21.15.133:0/1177612834 >> v1:172.21.15.133:6789/0 conn(0x7efee80cbde0 legacy=0x7efee8161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:55.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.837+0000 7efee77fe640 1 -- 172.21.15.133:0/1177612834 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee81578f0 con 0x7efee81516d0 2024-01-19T05:01:55.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.845+0000 7efee77fe640 1 --2- 172.21.15.133:0/1177612834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81516d0 0x7efee80c52b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efedc009870 tx=0x7efedc01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb0821cd39bd808 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efee6ffd640 1 -- 172.21.15.133:0/1177612834 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0a89b0 con 0x7efee81516d0 2024-01-19T05:01:55.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efee6ffd640 1 -- 172.21.15.133:0/1177612834 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc0a8b10 con 0x7efee81516d0 2024-01-19T05:01:55.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efee6ffd640 1 -- 172.21.15.133:0/1177612834 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0a8ea0 con 0x7efee81516d0 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 -- 172.21.15.133:0/1177612834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81516d0 msgr2=0x7efee80c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 --2- 172.21.15.133:0/1177612834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81516d0 0x7efee80c52b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efedc009870 tx=0x7efedc01ecb0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 -- 172.21.15.133:0/1177612834 shutdown_connections 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 --2- 172.21.15.133:0/1177612834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81516d0 0x7efee80c52b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 -- 172.21.15.133:0/1177612834 >> 172.21.15.133:0/1177612834 conn(0x7efee8072890 msgr2=0x7efee806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 -- 172.21.15.133:0/1177612834 shutdown_connections 2024-01-19T05:01:55.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.857+0000 7efeee49d640 1 -- 172.21.15.133:0/1177612834 wait complete. 2024-01-19T05:01:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 Processor -- start 2024-01-19T05:01:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 -- start start 2024-01-19T05:01:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efee80cbde0 0x7efee81590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81512f0 0x7efee80cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 0x7efee8155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee815ad60 con 0x7efee81516d0 2024-01-19T05:01:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee814c620 con 0x7efee81512f0 2024-01-19T05:01:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeee49d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee8150470 con 0x7efee80cbde0 2024-01-19T05:01:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeeca3a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 0x7efee8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeeca3a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 0x7efee8155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60612/0 (socket says 172.21.15.133:60612) 2024-01-19T05:01:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efeeca3a640 1 -- 172.21.15.133:0/3267388534 learned_addr learned my addr 172.21.15.133:0/3267388534 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.861+0000 7efee7fff640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efee80cbde0 0x7efee81590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.865+0000 7efee77fe640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81512f0 0x7efee80cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.865+0000 7efeeca3a640 1 -- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efee80cbde0 msgr2=0x7efee81590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.865+0000 7efeeca3a640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efee80cbde0 0x7efee81590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.865+0000 7efeeca3a640 1 -- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81512f0 msgr2=0x7efee80cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.865+0000 7efeeca3a640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81512f0 0x7efee80cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.865+0000 7efeeca3a640 1 -- 172.21.15.133:0/3267388534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc0094d0 con 0x7efee81516d0 2024-01-19T05:01:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.873+0000 7efeeca3a640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 0x7efee8155340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efee000b990 tx=0x7efee000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.877+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000cba0 con 0x7efee81516d0 2024-01-19T05:01:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.877+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000cd00 con 0x7efee81516d0 2024-01-19T05:01:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.877+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0014680 con 0x7efee81516d0 2024-01-19T05:01:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.877+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee814f860 con 0x7efee81516d0 2024-01-19T05:01:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.877+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee814fe20 con 0x7efee81516d0 2024-01-19T05:01:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.877+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee8070390 con 0x7efee81516d0 2024-01-19T05:01:55.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.897+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efee0007370 con 0x7efee81516d0 2024-01-19T05:01:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.897+0000 7efee4ff9640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efed4066580 0x7efed4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.897+0000 7efee7fff640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efed4066580 0x7efed4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:55.901+0000 7efee7fff640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efed4066580 0x7efed4068a40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efed8007fd0 tx=0x7efed8007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.177+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efee00551d0 con 0x7efee81516d0 2024-01-19T05:01:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.177+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efee0051510 con 0x7efee81516d0 2024-01-19T05:01:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.337+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efee8158170 con 0x7efed4066580 2024-01-19T05:01:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.337+0000 7efee4ff9640 1 -- 172.21.15.133:0/3267388534 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efed8004c00 con 0x7efed4066580 2024-01-19T05:01:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2024-01-19T05:01:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efed4066580 msgr2=0x7efed4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efed4066580 0x7efed4068a40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efed8007fd0 tx=0x7efed8007e40 comp rx=0 tx=0).stop 2024-01-19T05:01:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 msgr2=0x7efee8155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 0x7efee8155340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efee000b990 tx=0x7efee000be50 comp rx=0 tx=0).stop 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 shutdown_connections 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7efed4066580 0x7efed4068a40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efee81512f0 0x7efee80cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee81516d0 0x7efee8155340 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 --2- 172.21.15.133:0/3267388534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efee80cbde0 0x7efee81590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 >> 172.21.15.133:0/3267388534 conn(0x7efee8072890 msgr2=0x7efee815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 shutdown_connections 2024-01-19T05:01:56.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.341+0000 7efeee49d640 1 -- 172.21.15.133:0/3267388534 wait complete. 2024-01-19T05:01:56.358 INFO:tasks.ceph:Scrubbing osd.5 2024-01-19T05:01:56.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.493+0000 7f1c725f0640 1 Processor -- start 2024-01-19T05:01:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.493+0000 7f1c725f0640 1 -- start start 2024-01-19T05:01:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c725f0640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 0x7f1c6c0c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c725f0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c6c0c6640 0x7f1c6c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c725f0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c153c50 con 0x7f1c6c15ca50 2024-01-19T05:01:56.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c725f0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c06f810 con 0x7f1c6c0c6640 2024-01-19T05:01:56.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c725f0640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c06ec20 con 0x7f1c6c153870 2024-01-19T05:01:56.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c6bfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 0x7f1c6c0c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c6bfff640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 0x7f1c6c0c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:53694/0 (socket says 172.21.15.133:53694) 2024-01-19T05:01:56.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.497+0000 7f1c6bfff640 1 -- 172.21.15.133:0/2711673873 learned_addr learned my addr 172.21.15.133:0/2711673873 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:56.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.501+0000 7f1c63fff640 1 --2- 172.21.15.133:0/2711673873 >> v2:172.21.15.156:3300/0 conn(0x7f1c6c0c6640 0x7f1c6c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.505+0000 7f1c6bfff640 1 -- 172.21.15.133:0/2711673873 >> v2:172.21.15.156:3300/0 conn(0x7f1c6c0c6640 msgr2=0x7f1c6c06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.505+0000 7f1c6bfff640 1 --2- 172.21.15.133:0/2711673873 >> v2:172.21.15.156:3300/0 conn(0x7f1c6c0c6640 0x7f1c6c06a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.505+0000 7f1c6bfff640 1 -- 172.21.15.133:0/2711673873 >> v1:172.21.15.156:6789/0 conn(0x7f1c6c15ca50 legacy=0x7f1c6c15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:56.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.505+0000 7f1c6bfff640 1 -- 172.21.15.133:0/2711673873 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0664f0 con 0x7f1c6c153870 2024-01-19T05:01:56.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.509+0000 7f1c6bfff640 1 --2- 172.21.15.133:0/2711673873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 0x7f1c6c0c74c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009870 tx=0x7f1c5c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42cdcd2b1f7b9a8d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.521+0000 7f1c6b7fe640 1 -- 172.21.15.133:0/2711673873 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab600 con 0x7f1c6c153870 2024-01-19T05:01:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.641+0000 7f1c6b7fe640 1 -- 172.21.15.133:0/2711673873 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0a7050 con 0x7f1c6c153870 2024-01-19T05:01:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.641+0000 7f1c6b7fe640 1 -- 172.21.15.133:0/2711673873 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab980 con 0x7f1c6c153870 2024-01-19T05:01:56.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.641+0000 7f1c725f0640 1 -- 172.21.15.133:0/2711673873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 msgr2=0x7f1c6c0c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.641+0000 7f1c725f0640 1 --2- 172.21.15.133:0/2711673873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 0x7f1c6c0c74c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009870 tx=0x7f1c5c01c3b0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 -- 172.21.15.133:0/2711673873 shutdown_connections 2024-01-19T05:01:56.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 --2- 172.21.15.133:0/2711673873 >> v2:172.21.15.156:3300/0 conn(0x7f1c6c0c6640 0x7f1c6c06a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 --2- 172.21.15.133:0/2711673873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c153870 0x7f1c6c0c74c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 -- 172.21.15.133:0/2711673873 >> 172.21.15.133:0/2711673873 conn(0x7f1c6c0cb450 msgr2=0x7f1c6c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 -- 172.21.15.133:0/2711673873 shutdown_connections 2024-01-19T05:01:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 -- 172.21.15.133:0/2711673873 wait complete. 2024-01-19T05:01:56.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 Processor -- start 2024-01-19T05:01:56.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.645+0000 7f1c725f0640 1 -- start start 2024-01-19T05:01:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.649+0000 7f1c725f0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c6c0c6640 0x7f1c6c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.649+0000 7f1c725f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c153870 0x7f1c6c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.649+0000 7f1c725f0640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c15ca50 0x7f1c6c1eb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.649+0000 7f1c725f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1f2650 con 0x7f1c6c153870 2024-01-19T05:01:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.649+0000 7f1c725f0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c15a260 con 0x7f1c6c0c6640 2024-01-19T05:01:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.649+0000 7f1c725f0640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0caec0 con 0x7f1c6c15ca50 2024-01-19T05:01:56.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.653+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c153870 0x7f1c6c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.653+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c153870 0x7f1c6c151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60614/0 (socket says 172.21.15.133:60614) 2024-01-19T05:01:56.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.653+0000 7f1c63fff640 1 -- 172.21.15.133:0/4262342669 learned_addr learned my addr 172.21.15.133:0/4262342669 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:56.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.657+0000 7f1c6bfff640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c6c0c6640 0x7f1c6c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.657+0000 7f1c70b8d640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c15ca50 0x7f1c6c1eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.661+0000 7f1c63fff640 1 -- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c15ca50 msgr2=0x7f1c6c1eb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.661+0000 7f1c63fff640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c6c15ca50 0x7f1c6c1eb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.661+0000 7f1c63fff640 1 -- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c6c0c6640 msgr2=0x7f1c6c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.661+0000 7f1c63fff640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c6c0c6640 0x7f1c6c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.661+0000 7f1c63fff640 1 -- 172.21.15.133:0/4262342669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0094d0 con 0x7f1c6c153870 2024-01-19T05:01:56.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.665+0000 7f1c63fff640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c153870 0x7f1c6c151a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e930 tx=0x7f1c5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.673+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54009690 con 0x7f1c6c153870 2024-01-19T05:01:56.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.673+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400ca00 con 0x7f1c6c153870 2024-01-19T05:01:56.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.673+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400cdb0 con 0x7f1c6c153870 2024-01-19T05:01:56.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.673+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c1f2a70 con 0x7f1c6c153870 2024-01-19T05:01:56.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.673+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c1f1f90 con 0x7f1c6c153870 2024-01-19T05:01:56.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.673+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c6c06aba0 con 0x7f1c6c153870 2024-01-19T05:01:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.773+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1c54013470 con 0x7f1c6c153870 2024-01-19T05:01:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.773+0000 7f1c697fa640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1c4c066550 0x7f1c4c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.773+0000 7f1c6bfff640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1c4c066550 0x7f1c4c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.773+0000 7f1c6bfff640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1c4c066550 0x7f1c4c068a10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ad000 tx=0x7f1c5c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.785+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c54055ad0 con 0x7f1c6c153870 2024-01-19T05:01:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.785+0000 7f1c697fa640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7f1c4c06fe30 0x7f1c4c0722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.785+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 --> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c4c0729a0 con 0x7f1c4c06fe30 2024-01-19T05:01:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.785+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c54051710 con 0x7f1c6c153870 2024-01-19T05:01:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.785+0000 7f1c70b8d640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7f1c4c06fe30 0x7f1c4c0722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.789+0000 7f1c70b8d640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7f1c4c06fe30 0x7f1c4c0722d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.789+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== osd.5 v2:172.21.15.156:6818/1488223936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1c4c0729a0 con 0x7f1c4c06fe30 2024-01-19T05:01:56.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.809+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 --> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c6c06f430 con 0x7f1c4c06fe30 2024-01-19T05:01:56.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c697fa640 1 -- 172.21.15.133:0/4262342669 <== osd.5 v2:172.21.15.156:6818/1488223936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1c64009b30 con 0x7f1c4c06fe30 2024-01-19T05:01:56.811 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:56.812 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:56.812 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7f1c4c06fe30 msgr2=0x7f1c4c0722d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6818/1488223936,v1:172.21.15.156:6820/1488223936] conn(0x7f1c4c06fe30 0x7f1c4c0722d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1c4c066550 msgr2=0x7f1c4c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f1c4c066550 0x7f1c4c068a10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ad000 tx=0x7f1c5c008040 comp rx=0 tx=0).stop 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c153870 msgr2=0x7f1c6c151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 --2- 172.21.15.133:0/4262342669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c153870 0x7f1c6c151a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e930 tx=0x7f1c5400edf0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c70b8d640 1 -- 172.21.15.133:0/4262342669 reap_dead start 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 shutdown_connections 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 >> 172.21.15.133:0/4262342669 conn(0x7f1c6c0cb450 msgr2=0x7f1c6c15cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 shutdown_connections 2024-01-19T05:01:56.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.813+0000 7f1c725f0640 1 -- 172.21.15.133:0/4262342669 wait complete. 2024-01-19T05:01:56.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-19T05:01:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 Processor -- start 2024-01-19T05:01:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 -- start start 2024-01-19T05:01:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04b40ca600 0x7f04b415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04b40c9bd0 0x7f04b415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b406d3e0 con 0x7f04b4153710 2024-01-19T05:01:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b40b2120 con 0x7f04b40ca600 2024-01-19T05:01:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b8b14640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b40c3df0 con 0x7f04b40c9bd0 2024-01-19T05:01:56.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.965+0000 7f04b1d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04b40ca600 0x7f04b415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b1d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04b40ca600 0x7f04b415cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60622/0 (socket says 172.21.15.133:60622) 2024-01-19T05:01:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b1d9b640 1 -- 172.21.15.133:0/766596921 learned_addr learned my addr 172.21.15.133:0/766596921 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:56.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b2d9d640 1 --2- 172.21.15.133:0/766596921 >> v2:172.21.15.156:3300/0 conn(0x7f04b40c9bd0 0x7f04b415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b1d9b640 1 -- 172.21.15.133:0/766596921 >> v2:172.21.15.156:3300/0 conn(0x7f04b40c9bd0 msgr2=0x7f04b415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b1d9b640 1 --2- 172.21.15.133:0/766596921 >> v2:172.21.15.156:3300/0 conn(0x7f04b40c9bd0 0x7f04b415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b1d9b640 1 -- 172.21.15.133:0/766596921 >> v1:172.21.15.156:6789/0 conn(0x7f04b4153710 legacy=0x7f04b40c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:56.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.969+0000 7f04b1d9b640 1 -- 172.21.15.133:0/766596921 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b406c680 con 0x7f04b40ca600 2024-01-19T05:01:56.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.973+0000 7f04b1d9b640 1 --2- 172.21.15.133:0/766596921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b40ca600 0x7f04b415cb50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f04b40ca080 tx=0x7f04a801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31699f48d50b1c16 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.977+0000 7f04b159a640 1 -- 172.21.15.133:0/766596921 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80a89b0 con 0x7f04b40ca600 2024-01-19T05:01:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.977+0000 7f04b159a640 1 -- 172.21.15.133:0/766596921 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a80a8b10 con 0x7f04b40ca600 2024-01-19T05:01:56.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.977+0000 7f04b159a640 1 -- 172.21.15.133:0/766596921 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80a8ea0 con 0x7f04b40ca600 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- 172.21.15.133:0/766596921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b40ca600 msgr2=0x7f04b415cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 --2- 172.21.15.133:0/766596921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b40ca600 0x7f04b415cb50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f04b40ca080 tx=0x7f04a801ecb0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- 172.21.15.133:0/766596921 shutdown_connections 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 --2- 172.21.15.133:0/766596921 >> v2:172.21.15.156:3300/0 conn(0x7f04b40c9bd0 0x7f04b415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 --2- 172.21.15.133:0/766596921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b40ca600 0x7f04b415cb50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- 172.21.15.133:0/766596921 >> 172.21.15.133:0/766596921 conn(0x7f04b408b5a0 msgr2=0x7f04b4071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- 172.21.15.133:0/766596921 shutdown_connections 2024-01-19T05:01:56.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- 172.21.15.133:0/766596921 wait complete. 2024-01-19T05:01:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 Processor -- start 2024-01-19T05:01:56.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- start start 2024-01-19T05:01:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04b40c9bd0 0x7f04b40b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04b40ca600 0x7f04b414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 0x7f04b40b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4146810 con 0x7f04b4153710 2024-01-19T05:01:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40b4120 con 0x7f04b40ca600 2024-01-19T05:01:56.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b8b14640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b41eff60 con 0x7f04b40c9bd0 2024-01-19T05:01:56.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 0x7f04b40b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 0x7f04b40b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60626/0 (socket says 172.21.15.133:60626) 2024-01-19T05:01:56.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.981+0000 7f04b2d9d640 1 -- 172.21.15.133:0/4096219668 learned_addr learned my addr 172.21.15.133:0/4096219668 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b259c640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04b40c9bd0 0x7f04b40b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b1d9b640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04b40ca600 0x7f04b414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b2d9d640 1 -- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04b40c9bd0 msgr2=0x7f04b40b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b2d9d640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04b40c9bd0 0x7f04b40b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b2d9d640 1 -- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04b40ca600 msgr2=0x7f04b414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b2d9d640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04b40ca600 0x7f04b414ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:56.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.985+0000 7f04b2d9d640 1 -- 172.21.15.133:0/4096219668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a80094d0 con 0x7f04b4153710 2024-01-19T05:01:56.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.989+0000 7f04b2d9d640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 0x7f04b40b2cd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00efc0 tx=0x7f04ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.993+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac009ba0 con 0x7f04b4153710 2024-01-19T05:01:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.993+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac00f040 con 0x7f04b4153710 2024-01-19T05:01:56.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.993+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0146c0 con 0x7f04b4153710 2024-01-19T05:01:56.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.993+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b40b3620 con 0x7f04b4153710 2024-01-19T05:01:56.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.993+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b40b24d0 con 0x7f04b4153710 2024-01-19T05:01:56.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:56.993+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b4074340 con 0x7f04b4153710 2024-01-19T05:01:57.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.013+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f04ac014820 con 0x7f04b4153710 2024-01-19T05:01:57.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.013+0000 7f04a2ffd640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0494066550 0x7f0494068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.013+0000 7f04b259c640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0494066550 0x7f0494068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.017+0000 7f04b259c640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0494066550 0x7f0494068a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f04a4007fd0 tx=0x7f04a4007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.173+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04ac056110 con 0x7f04b4153710 2024-01-19T05:01:57.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.293+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f04ac052450 con 0x7f04b4153710 2024-01-19T05:01:57.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.453+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f04b40c4320 con 0x7f0494066550 2024-01-19T05:01:57.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.453+0000 7f04a2ffd640 1 -- 172.21.15.133:0/4096219668 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f04a4004c00 con 0x7f0494066550 2024-01-19T05:01:57.455 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0494066550 msgr2=0x7f0494068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0494066550 0x7f0494068a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f04a4007fd0 tx=0x7f04a4007e40 comp rx=0 tx=0).stop 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 msgr2=0x7f04b40b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 0x7f04b40b2cd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00efc0 tx=0x7f04ac00c490 comp rx=0 tx=0).stop 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 shutdown_connections 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f0494066550 0x7f0494068a10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04b40ca600 0x7f04b414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b4153710 0x7f04b40b2cd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 --2- 172.21.15.133:0/4096219668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04b40c9bd0 0x7f04b40b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 >> 172.21.15.133:0/4096219668 conn(0x7f04b408b5a0 msgr2=0x7f04b40cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:57.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 shutdown_connections 2024-01-19T05:01:57.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.457+0000 7f04b8b14640 1 -- 172.21.15.133:0/4096219668 wait complete. 2024-01-19T05:01:57.474 INFO:tasks.ceph:Scrubbing osd.6 2024-01-19T05:01:57.474 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:57.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.597+0000 7fb176444640 1 Processor -- start 2024-01-19T05:01:57.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.597+0000 7fb176444640 1 -- start start 2024-01-19T05:01:57.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb176444640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb170151840 0x7fb17006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb176444640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb1700cc9f0 0x7fb17015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb176444640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700c7070 con 0x7fb17006f860 2024-01-19T05:01:57.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb176444640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700c7880 con 0x7fb170151840 2024-01-19T05:01:57.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb176444640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb170151c20 con 0x7fb1700cc9f0 2024-01-19T05:01:57.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb16ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb170151840 0x7fb17006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb1749e1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb17006f860 0x7fb1701574f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44850/0 (socket says 172.21.15.133:44850) 2024-01-19T05:01:57.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.601+0000 7fb1749e1640 1 -- 172.21.15.133:0/2361816995 learned_addr learned my addr 172.21.15.133:0/2361816995 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:57.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.609+0000 7fb16ffff640 1 -- 172.21.15.133:0/2361816995 >> v2:172.21.15.156:3300/0 conn(0x7fb1700cc9f0 msgr2=0x7fb17015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:57.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.609+0000 7fb16ffff640 1 --2- 172.21.15.133:0/2361816995 >> v2:172.21.15.156:3300/0 conn(0x7fb1700cc9f0 0x7fb17015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.609+0000 7fb16ffff640 1 -- 172.21.15.133:0/2361816995 >> v1:172.21.15.133:6789/0 conn(0x7fb17006f860 legacy=0x7fb1701574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.609+0000 7fb16ffff640 1 -- 172.21.15.133:0/2361816995 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700c72c0 con 0x7fb170151840 2024-01-19T05:01:57.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.617+0000 7fb16ffff640 1 --2- 172.21.15.133:0/2361816995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb170151840 0x7fb17006e740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb17006c910 tx=0x7fb16801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bb5d585cefbcad server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb16effd640 1 -- 172.21.15.133:0/2361816995 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680a8950 con 0x7fb170151840 2024-01-19T05:01:57.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb16effd640 1 -- 172.21.15.133:0/2361816995 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1680a8ab0 con 0x7fb170151840 2024-01-19T05:01:57.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb16effd640 1 -- 172.21.15.133:0/2361816995 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680a8e40 con 0x7fb170151840 2024-01-19T05:01:57.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 -- 172.21.15.133:0/2361816995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb170151840 msgr2=0x7fb17006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 --2- 172.21.15.133:0/2361816995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb170151840 0x7fb17006e740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb17006c910 tx=0x7fb16801ec50 comp rx=0 tx=0).stop 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 -- 172.21.15.133:0/2361816995 shutdown_connections 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 --2- 172.21.15.133:0/2361816995 >> v2:172.21.15.156:3300/0 conn(0x7fb1700cc9f0 0x7fb17015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 --2- 172.21.15.133:0/2361816995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb170151840 0x7fb17006e740 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 -- 172.21.15.133:0/2361816995 >> 172.21.15.133:0/2361816995 conn(0x7fb170072690 msgr2=0x7fb1700cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 -- 172.21.15.133:0/2361816995 shutdown_connections 2024-01-19T05:01:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.625+0000 7fb176444640 1 -- 172.21.15.133:0/2361816995 wait complete. 2024-01-19T05:01:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 Processor -- start 2024-01-19T05:01:57.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 -- start start 2024-01-19T05:01:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb17006f860 0x7fb17014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1700cc9f0 0x7fb1700caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb170151840 0x7fb1700c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700c39c0 con 0x7fb1700cc9f0 2024-01-19T05:01:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701ed2e0 con 0x7fb170151840 2024-01-19T05:01:57.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb176444640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701ed500 con 0x7fb17006f860 2024-01-19T05:01:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb16f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1700cc9f0 0x7fb1700caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb16f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1700cc9f0 0x7fb1700caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60640/0 (socket says 172.21.15.133:60640) 2024-01-19T05:01:57.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.629+0000 7fb16f7fe640 1 -- 172.21.15.133:0/2969959216 learned_addr learned my addr 172.21.15.133:0/2969959216 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.637+0000 7fb16f7fe640 1 -- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb17006f860 msgr2=0x7fb17014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.637+0000 7fb16f7fe640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb17006f860 0x7fb17014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.637+0000 7fb16f7fe640 1 -- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb170151840 msgr2=0x7fb1700c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.637+0000 7fb16f7fe640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb170151840 0x7fb1700c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.637+0000 7fb16f7fe640 1 -- 172.21.15.133:0/2969959216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168009420 con 0x7fb1700cc9f0 2024-01-19T05:01:57.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.637+0000 7fb16f7fe640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1700cc9f0 0x7fb1700caf20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb15800b580 tx=0x7fb15800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.645+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158010870 con 0x7fb1700cc9f0 2024-01-19T05:01:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.645+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1580109f0 con 0x7fb1700cc9f0 2024-01-19T05:01:57.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.645+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158010da0 con 0x7fb1700cc9f0 2024-01-19T05:01:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.645+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700c3bd0 con 0x7fb1700cc9f0 2024-01-19T05:01:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.645+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1700c4190 con 0x7fb1700cc9f0 2024-01-19T05:01:57.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.645+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb17015ae50 con 0x7fb1700cc9f0 2024-01-19T05:01:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.665+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb15800f3c0 con 0x7fb1700cc9f0 2024-01-19T05:01:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.665+0000 7fb16cff9640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb150066530 0x7fb1500689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.665+0000 7fb16ffff640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb150066530 0x7fb1500689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.665+0000 7fb16ffff640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb150066530 0x7fb1500689f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb1680b2000 tx=0x7fb168004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.669+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb158055a30 con 0x7fb1700cc9f0 2024-01-19T05:01:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.669+0000 7fb16cff9640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7fb15006fd90 0x7fb150072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.669+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 --> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb150072900 con 0x7fb15006fd90 2024-01-19T05:01:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.669+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb158024eb0 con 0x7fb1700cc9f0 2024-01-19T05:01:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.669+0000 7fb1749e1640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7fb15006fd90 0x7fb150072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.669+0000 7fb1749e1640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7fb15006fd90 0x7fb150072230 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.673+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== osd.6 v2:172.21.15.156:6819/2521997623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb150072900 con 0x7fb15006fd90 2024-01-19T05:01:57.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 --> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb17015ab70 con 0x7fb15006fd90 2024-01-19T05:01:57.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb16cff9640 1 -- 172.21.15.133:0/2969959216 <== osd.6 v2:172.21.15.156:6819/2521997623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb160001c20 con 0x7fb15006fd90 2024-01-19T05:01:57.686 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:57.686 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:57.686 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7fb15006fd90 msgr2=0x7fb150072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6819/2521997623,v1:172.21.15.156:6821/2521997623] conn(0x7fb15006fd90 0x7fb150072230 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb150066530 msgr2=0x7fb1500689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fb150066530 0x7fb1500689f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb1680b2000 tx=0x7fb168004740 comp rx=0 tx=0).stop 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1700cc9f0 msgr2=0x7fb1700caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 --2- 172.21.15.133:0/2969959216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1700cc9f0 0x7fb1700caf20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb15800b580 tx=0x7fb15800ba40 comp rx=0 tx=0).stop 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb1749e1640 1 -- 172.21.15.133:0/2969959216 reap_dead start 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 shutdown_connections 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 >> 172.21.15.133:0/2969959216 conn(0x7fb170072690 msgr2=0x7fb17014c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.685+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 shutdown_connections 2024-01-19T05:01:57.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.689+0000 7fb176444640 1 -- 172.21.15.133:0/2969959216 wait complete. 2024-01-19T05:01:57.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-19T05:01:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.833+0000 7fe727155640 1 Processor -- start 2024-01-19T05:01:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.833+0000 7fe727155640 1 -- start start 2024-01-19T05:01:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.833+0000 7fe727155640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7200c6190 0x7fe7200c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.833+0000 7fe727155640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7200c7620 0x7fe7201507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.833+0000 7fe727155640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7200c5220 con 0x7fe7200c6570 2024-01-19T05:01:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.833+0000 7fe727155640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7200c5a50 con 0x7fe7200c6190 2024-01-19T05:01:57.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.837+0000 7fe727155640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe720157260 con 0x7fe7200c7620 2024-01-19T05:01:57.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.837+0000 7fe7256f2640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7200c7620 0x7fe7201507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.837+0000 7fe71ffff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe7200c6570 0x7fe720150090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.133:46932/0 (socket says 172.21.15.133:46932) 2024-01-19T05:01:57.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.837+0000 7fe71ffff640 1 -- 172.21.15.133:0/2815002165 learned_addr learned my addr 172.21.15.133:0/2815002165 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:57.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.845+0000 7fe7256f2640 1 -- 172.21.15.133:0/2815002165 >> v2:172.21.15.133:3300/0 conn(0x7fe7200c6190 msgr2=0x7fe7200c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:57.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.845+0000 7fe7256f2640 1 --2- 172.21.15.133:0/2815002165 >> v2:172.21.15.133:3300/0 conn(0x7fe7200c6190 0x7fe7200c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.845+0000 7fe7256f2640 1 -- 172.21.15.133:0/2815002165 >> v1:172.21.15.156:6789/0 conn(0x7fe7200c6570 legacy=0x7fe720150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.845+0000 7fe7256f2640 1 -- 172.21.15.133:0/2815002165 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7200c5490 con 0x7fe7200c7620 2024-01-19T05:01:57.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.853+0000 7fe7256f2640 1 --2- 172.21.15.133:0/2815002165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c7620 0x7fe7201507a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7200c90d0 tx=0x7fe71801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94ed4928793c8d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe71f7fe640 1 -- 172.21.15.133:0/2815002165 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180a5910 con 0x7fe7200c7620 2024-01-19T05:01:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe71f7fe640 1 -- 172.21.15.133:0/2815002165 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180a5a70 con 0x7fe7200c7620 2024-01-19T05:01:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe71f7fe640 1 -- 172.21.15.133:0/2815002165 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180a5e00 con 0x7fe7200c7620 2024-01-19T05:01:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 -- 172.21.15.133:0/2815002165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c7620 msgr2=0x7fe7201507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 --2- 172.21.15.133:0/2815002165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c7620 0x7fe7201507a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7200c90d0 tx=0x7fe71801c850 comp rx=0 tx=0).stop 2024-01-19T05:01:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 -- 172.21.15.133:0/2815002165 shutdown_connections 2024-01-19T05:01:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 --2- 172.21.15.133:0/2815002165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c7620 0x7fe7201507a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 --2- 172.21.15.133:0/2815002165 >> v2:172.21.15.133:3300/0 conn(0x7fe7200c6190 0x7fe7200c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 -- 172.21.15.133:0/2815002165 >> 172.21.15.133:0/2815002165 conn(0x7fe72006fa20 msgr2=0x7fe7200c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 -- 172.21.15.133:0/2815002165 shutdown_connections 2024-01-19T05:01:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.869+0000 7fe727155640 1 -- 172.21.15.133:0/2815002165 wait complete. 2024-01-19T05:01:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 Processor -- start 2024-01-19T05:01:57.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 -- start start 2024-01-19T05:01:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 0x7fe720071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c6570 0x7fe7201433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7200c7620 0x7fe720143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe720142fc0 con 0x7fe7200c7620 2024-01-19T05:01:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72014d580 con 0x7fe7200c6570 2024-01-19T05:01:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe727155640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe720144850 con 0x7fe7200c6190 2024-01-19T05:01:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c6570 0x7fe7201433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.873+0000 7fe724ef1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 0x7fe720071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.877+0000 7fe724ef1640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 0x7fe720071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:53726/0 (socket says 172.21.15.133:53726) 2024-01-19T05:01:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.877+0000 7fe724ef1640 1 -- 172.21.15.133:0/1808438506 learned_addr learned my addr 172.21.15.133:0/1808438506 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:57.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.889+0000 7fe724ef1640 1 -- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c6570 msgr2=0x7fe7201433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.889+0000 7fe724ef1640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c6570 0x7fe7201433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.889+0000 7fe724ef1640 1 -- 172.21.15.133:0/1808438506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7200c7620 msgr2=0x7fe720143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:57.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.889+0000 7fe724ef1640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7200c7620 0x7fe720143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:57.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.889+0000 7fe724ef1640 1 -- 172.21.15.133:0/1808438506 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009a70 con 0x7fe7200c6190 2024-01-19T05:01:57.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.897+0000 7fe724ef1640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 0x7fe720071a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe71000b410 tx=0x7fe71000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.909+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710011830 con 0x7fe7200c6190 2024-01-19T05:01:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.909+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe710011990 con 0x7fe7200c6190 2024-01-19T05:01:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.909+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7201f4280 con 0x7fe7200c6190 2024-01-19T05:01:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.909+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710011d40 con 0x7fe7200c6190 2024-01-19T05:01:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.909+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe720144aa0 con 0x7fe7200c6190 2024-01-19T05:01:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.909+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe720143100 con 0x7fe7200c6190 2024-01-19T05:01:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.961+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe71001a400 con 0x7fe7200c6190 2024-01-19T05:01:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.961+0000 7fe71d7fa640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe70c066550 0x7fe70c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.961+0000 7fe71ffff640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe70c066550 0x7fe70c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:57.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:57.961+0000 7fe71ffff640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe70c066550 0x7fe70c068a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7201f41b0 tx=0x7fe714009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.253+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe710055a80 con 0x7fe7200c6190 2024-01-19T05:01:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.301+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe7100516c0 con 0x7fe7200c6190 2024-01-19T05:01:58.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe720156f00 con 0x7fe70c066550 2024-01-19T05:01:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe71d7fa640 1 -- 172.21.15.133:0/1808438506 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe714001470 con 0x7fe70c066550 2024-01-19T05:01:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe70c066550 msgr2=0x7fe70c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe70c066550 0x7fe70c068a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7201f41b0 tx=0x7fe714009040 comp rx=0 tx=0).stop 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 msgr2=0x7fe720071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 0x7fe720071a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe71000b410 tx=0x7fe71000b8d0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 shutdown_connections 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe70c066550 0x7fe70c068a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7200c6570 0x7fe7201433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7200c7620 0x7fe720143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 --2- 172.21.15.133:0/1808438506 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7200c6190 0x7fe720071a50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 >> 172.21.15.133:0/1808438506 conn(0x7fe72006fa20 msgr2=0x7fe7200c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 shutdown_connections 2024-01-19T05:01:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.513+0000 7fe727155640 1 -- 172.21.15.133:0/1808438506 wait complete. 2024-01-19T05:01:58.534 INFO:tasks.ceph:Scrubbing osd.7 2024-01-19T05:01:58.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:01:58.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.661+0000 7ffa243fb640 1 Processor -- start 2024-01-19T05:01:58.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.661+0000 7ffa243fb640 1 -- start start 2024-01-19T05:01:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa243fb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa1c1538f0 0x7ffa1c0c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa243fb640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffa1c0c2d70 0x7ffa1c159640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa243fb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c15a600 con 0x7ffa1c15d550 2024-01-19T05:01:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa243fb640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c159b80 con 0x7ffa1c1538f0 2024-01-19T05:01:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa243fb640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c159d60 con 0x7ffa1c0c2d70 2024-01-19T05:01:58.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa22197640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa1c1538f0 0x7ffa1c0c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa22998640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa1c15d550 0x7ffa1c0c7ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44858/0 (socket says 172.21.15.133:44858) 2024-01-19T05:01:58.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.665+0000 7ffa22998640 1 -- 172.21.15.133:0/264592606 learned_addr learned my addr 172.21.15.133:0/264592606 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.669+0000 7ffa22197640 1 -- 172.21.15.133:0/264592606 >> v2:172.21.15.156:3300/0 conn(0x7ffa1c0c2d70 msgr2=0x7ffa1c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.669+0000 7ffa22197640 1 --2- 172.21.15.133:0/264592606 >> v2:172.21.15.156:3300/0 conn(0x7ffa1c0c2d70 0x7ffa1c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.669+0000 7ffa22197640 1 -- 172.21.15.133:0/264592606 >> v1:172.21.15.133:6789/0 conn(0x7ffa1c15d550 legacy=0x7ffa1c0c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.669+0000 7ffa22197640 1 -- 172.21.15.133:0/264592606 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c15a040 con 0x7ffa1c1538f0 2024-01-19T05:01:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.673+0000 7ffa22197640 1 --2- 172.21.15.133:0/264592606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c0c9bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c072b10 tx=0x7ffa1801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da15fc52ca7cd92f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.677+0000 7ffa21195640 1 -- 172.21.15.133:0/264592606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180a8950 con 0x7ffa1c1538f0 2024-01-19T05:01:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa21195640 1 -- 172.21.15.133:0/264592606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180a8ab0 con 0x7ffa1c1538f0 2024-01-19T05:01:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa21195640 1 -- 172.21.15.133:0/264592606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180a8e40 con 0x7ffa1c1538f0 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- 172.21.15.133:0/264592606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 msgr2=0x7ffa1c0c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 --2- 172.21.15.133:0/264592606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c0c9bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c072b10 tx=0x7ffa1801ec50 comp rx=0 tx=0).stop 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- 172.21.15.133:0/264592606 shutdown_connections 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 --2- 172.21.15.133:0/264592606 >> v2:172.21.15.156:3300/0 conn(0x7ffa1c0c2d70 0x7ffa1c159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 --2- 172.21.15.133:0/264592606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c0c9bd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- 172.21.15.133:0/264592606 >> 172.21.15.133:0/264592606 conn(0x7ffa1c06a660 msgr2=0x7ffa1c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- 172.21.15.133:0/264592606 shutdown_connections 2024-01-19T05:01:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- 172.21.15.133:0/264592606 wait complete. 2024-01-19T05:01:58.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 Processor -- start 2024-01-19T05:01:58.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- start start 2024-01-19T05:01:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0c2d70 0x7ffa1c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15d550 0x7ffa1c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c1efc70 con 0x7ffa1c1538f0 2024-01-19T05:01:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c1f01a0 con 0x7ffa1c15d550 2024-01-19T05:01:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa243fb640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c14f4e0 con 0x7ffa1c0c2d70 2024-01-19T05:01:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa21996640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa21996640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60684/0 (socket says 172.21.15.133:60684) 2024-01-19T05:01:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.681+0000 7ffa21996640 1 -- 172.21.15.133:0/2430982798 learned_addr learned my addr 172.21.15.133:0/2430982798 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:58.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.685+0000 7ffa21996640 1 -- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0c2d70 msgr2=0x7ffa1c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.685+0000 7ffa21996640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa1c0c2d70 0x7ffa1c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.685+0000 7ffa21996640 1 -- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15d550 msgr2=0x7ffa1c14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.685+0000 7ffa21996640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa1c15d550 0x7ffa1c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.685+0000 7ffa21996640 1 -- 172.21.15.133:0/2430982798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009420 con 0x7ffa1c1538f0 2024-01-19T05:01:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.689+0000 7ffa21996640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c158a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00b4b0 tx=0x7ffa0c00b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.693+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c010610 con 0x7ffa1c1538f0 2024-01-19T05:01:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.693+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c010770 con 0x7ffa1c1538f0 2024-01-19T05:01:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.693+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c010b20 con 0x7ffa1c1538f0 2024-01-19T05:01:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.693+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c1efec0 con 0x7ffa1c1538f0 2024-01-19T05:01:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.693+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c14f200 con 0x7ffa1c1538f0 2024-01-19T05:01:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.693+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa1c15d030 con 0x7ffa1c1538f0 2024-01-19T05:01:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.713+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ffa0c010c80 con 0x7ffa1c1538f0 2024-01-19T05:01:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.717+0000 7ffa12ffd640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ffa00066550 0x7ffa00068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.717+0000 7ffa22197640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ffa00066550 0x7ffa00068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.717+0000 7ffa22197640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ffa00066550 0x7ffa00068a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffa180b2000 tx=0x7ffa18004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.717+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa0c0556a0 con 0x7ffa1c1538f0 2024-01-19T05:01:58.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.721+0000 7ffa12ffd640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7ffa0006fe30 0x7ffa000722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.721+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 --> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa000729a0 con 0x7ffa0006fe30 2024-01-19T05:01:58.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.721+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa0c0512e0 con 0x7ffa1c1538f0 2024-01-19T05:01:58.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.721+0000 7ffa22998640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7ffa0006fe30 0x7ffa000722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.721+0000 7ffa22998640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7ffa0006fe30 0x7ffa000722d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.721+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== osd.7 v2:172.21.15.156:6802/413680273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffa000729a0 con 0x7ffa0006fe30 2024-01-19T05:01:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 --> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa1c153cd0 con 0x7ffa0006fe30 2024-01-19T05:01:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa12ffd640 1 -- 172.21.15.133:0/2430982798 <== osd.7 v2:172.21.15.156:6802/413680273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffa14001b80 con 0x7ffa0006fe30 2024-01-19T05:01:58.737 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-19T05:01:58.737 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:01:58.737 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-19T05:01:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7ffa0006fe30 msgr2=0x7ffa000722d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6802/413680273,v1:172.21.15.156:6803/413680273] conn(0x7ffa0006fe30 0x7ffa000722d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ffa00066550 msgr2=0x7ffa00068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7ffa00066550 0x7ffa00068a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffa180b2000 tx=0x7ffa18004740 comp rx=0 tx=0).stop 2024-01-19T05:01:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 msgr2=0x7ffa1c158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 --2- 172.21.15.133:0/2430982798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c1538f0 0x7ffa1c158a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00b4b0 tx=0x7ffa0c00b970 comp rx=0 tx=0).stop 2024-01-19T05:01:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa22998640 1 -- 172.21.15.133:0/2430982798 reap_dead start 2024-01-19T05:01:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 shutdown_connections 2024-01-19T05:01:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 >> 172.21.15.133:0/2430982798 conn(0x7ffa1c06a660 msgr2=0x7ffa1c070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 shutdown_connections 2024-01-19T05:01:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.737+0000 7ffa243fb640 1 -- 172.21.15.133:0/2430982798 wait complete. 2024-01-19T05:01:58.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-19T05:01:58.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 Processor -- start 2024-01-19T05:01:58.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 -- start start 2024-01-19T05:01:58.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8160 0x7f58e00c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58e00c8dc0 0x7f58e015a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e00c3200 con 0x7f58e0151640 2024-01-19T05:01:58.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e00b0530 con 0x7f58e00c8dc0 2024-01-19T05:01:58.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e7418640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00c8580 con 0x7f58e00c8160 2024-01-19T05:01:58.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e51b4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f58e0151640 0x7f58e00ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44864/0 (socket says 172.21.15.133:44864) 2024-01-19T05:01:58.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e51b4640 1 -- 172.21.15.133:0/1025901865 learned_addr learned my addr 172.21.15.133:0/1025901865 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:58.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.873+0000 7f58e49b3640 1 --2- 172.21.15.133:0/1025901865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8160 0x7f58e00c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.877+0000 7f58e59b5640 1 --2- 172.21.15.133:0/1025901865 >> v2:172.21.15.156:3300/0 conn(0x7f58e00c8dc0 0x7f58e015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.877+0000 7f58dffff640 1 -- 172.21.15.133:0/1025901865 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366865961 0 0) 0x7f58e00c3200 con 0x7f58e0151640 2024-01-19T05:01:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.877+0000 7f58dffff640 1 -- 172.21.15.133:0/1025901865 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58cc003530 con 0x7f58e0151640 2024-01-19T05:01:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.881+0000 7f58e49b3640 1 -- 172.21.15.133:0/1025901865 >> v2:172.21.15.156:3300/0 conn(0x7f58e00c8dc0 msgr2=0x7f58e015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.881+0000 7f58e49b3640 1 --2- 172.21.15.133:0/1025901865 >> v2:172.21.15.156:3300/0 conn(0x7f58e00c8dc0 0x7f58e015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.881+0000 7f58e49b3640 1 -- 172.21.15.133:0/1025901865 >> v1:172.21.15.133:6789/0 conn(0x7f58e0151640 legacy=0x7f58e00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.881+0000 7f58e49b3640 1 -- 172.21.15.133:0/1025901865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00c9230 con 0x7f58e00c8160 2024-01-19T05:01:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.885+0000 7f58e49b3640 1 --2- 172.21.15.133:0/1025901865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8160 0x7f58e00c3690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009d90 tx=0x7f58d801f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea7ee0deb5fc0fc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58dffff640 1 -- 172.21.15.133:0/1025901865 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80af600 con 0x7f58e00c8160 2024-01-19T05:01:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58dffff640 1 -- 172.21.15.133:0/1025901865 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d80ab050 con 0x7f58e00c8160 2024-01-19T05:01:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58dffff640 1 -- 172.21.15.133:0/1025901865 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80af980 con 0x7f58e00c8160 2024-01-19T05:01:58.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 -- 172.21.15.133:0/1025901865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8160 msgr2=0x7f58e00c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 --2- 172.21.15.133:0/1025901865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8160 0x7f58e00c3690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009d90 tx=0x7f58d801f130 comp rx=0 tx=0).stop 2024-01-19T05:01:58.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 -- 172.21.15.133:0/1025901865 shutdown_connections 2024-01-19T05:01:58.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 --2- 172.21.15.133:0/1025901865 >> v2:172.21.15.156:3300/0 conn(0x7f58e00c8dc0 0x7f58e015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 --2- 172.21.15.133:0/1025901865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8160 0x7f58e00c3690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 -- 172.21.15.133:0/1025901865 >> 172.21.15.133:0/1025901865 conn(0x7f58e006a660 msgr2=0x7f58e006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:58.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 -- 172.21.15.133:0/1025901865 shutdown_connections 2024-01-19T05:01:58.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.897+0000 7f58e7418640 1 -- 172.21.15.133:0/1025901865 wait complete. 2024-01-19T05:01:58.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 Processor -- start 2024-01-19T05:01:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 -- start start 2024-01-19T05:01:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 0x7f58e00acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8dc0 0x7f58e006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e0151640 0x7f58e006c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00af7e0 con 0x7f58e0151640 2024-01-19T05:01:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00ad690 con 0x7f58e00c8160 2024-01-19T05:01:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e7418640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e01f0400 con 0x7f58e00c8dc0 2024-01-19T05:01:58.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e51b4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 0x7f58e00acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.901+0000 7f58e49b3640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8dc0 0x7f58e006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.905+0000 7f58e51b4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 0x7f58e00acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:33266/0 (socket says 172.21.15.133:33266) 2024-01-19T05:01:58.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.905+0000 7f58e51b4640 1 -- 172.21.15.133:0/28563366 learned_addr learned my addr 172.21.15.133:0/28563366 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.913+0000 7f58e51b4640 1 -- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8dc0 msgr2=0x7f58e006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.913+0000 7f58e51b4640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8dc0 0x7f58e006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.913+0000 7f58e51b4640 1 -- 172.21.15.133:0/28563366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e0151640 msgr2=0x7f58e006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.913+0000 7f58e51b4640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e0151640 0x7f58e006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.913+0000 7f58e51b4640 1 -- 172.21.15.133:0/28563366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8009a70 con 0x7f58e00c8160 2024-01-19T05:01:58.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.921+0000 7f58e51b4640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 0x7f58e00acd40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58d000c420 tx=0x7f58d000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:58.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.929+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0005cf0 con 0x7f58e00c8160 2024-01-19T05:01:58.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.929+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d0005e50 con 0x7f58e00c8160 2024-01-19T05:01:58.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.929+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00072d0 con 0x7f58e00c8160 2024-01-19T05:01:58.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.929+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00aeeb0 con 0x7f58e00c8160 2024-01-19T05:01:58.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.929+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00af470 con 0x7f58e00c8160 2024-01-19T05:01:58.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.933+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e00ca730 con 0x7f58e00c8160 2024-01-19T05:01:58.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.993+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f58d0007430 con 0x7f58e00c8160 2024-01-19T05:01:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.993+0000 7f58ddffb640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58c0066550 0x7f58c0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.993+0000 7f58e49b3640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58c0066550 0x7f58c0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:58.993+0000 7f58e49b3640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58c0066550 0x7f58c0068a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58d80b1000 tx=0x7f58d80aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:59.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.333+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f58d0054920 con 0x7f58e00c8160 2024-01-19T05:01:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.377+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f58d0050c60 con 0x7f58e00c8160 2024-01-19T05:01:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.553+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f58e00679b0 con 0x7f58c0066550 2024-01-19T05:01:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58ddffb640 1 -- 172.21.15.133:0/28563366 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f58e00679b0 con 0x7f58c0066550 2024-01-19T05:01:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2024-01-19T05:01:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58c0066550 msgr2=0x7f58c0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58c0066550 0x7f58c0068a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58d80b1000 tx=0x7f58d80aa000 comp rx=0 tx=0).stop 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 msgr2=0x7f58e00acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 0x7f58e00acd40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58d000c420 tx=0x7f58d000c8e0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 shutdown_connections 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f58c0066550 0x7f58c0068a10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58e0151640 0x7f58e006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e00c8dc0 0x7f58e006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 --2- 172.21.15.133:0/28563366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e00c8160 0x7f58e00acd40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 >> 172.21.15.133:0/28563366 conn(0x7f58e006a660 msgr2=0x7f58e00cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 shutdown_connections 2024-01-19T05:01:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.557+0000 7f58e7418640 1 -- 172.21.15.133:0/28563366 wait complete. 2024-01-19T05:01:59.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:01:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 Processor -- start 2024-01-19T05:01:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 -- start start 2024-01-19T05:01:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800bffd0 0x7fa580159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5800cb750 0x7fa58015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800722a0 con 0x7fa5800cb370 2024-01-19T05:01:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa580072580 con 0x7fa5800cb750 2024-01-19T05:01:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa5848b7640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa580072860 con 0x7fa5800bffd0 2024-01-19T05:01:59.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa57ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5800cb750 0x7fa58015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:59.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa57e59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa5800cb370 0x7fa580071a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44876/0 (socket says 172.21.15.133:44876) 2024-01-19T05:01:59.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.709+0000 7fa57e59c640 1 -- 172.21.15.133:0/3562707328 learned_addr learned my addr 172.21.15.133:0/3562707328 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:01:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.713+0000 7fa57ed9d640 1 -- 172.21.15.133:0/3562707328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800bffd0 msgr2=0x7fa580159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:01:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.713+0000 7fa57ed9d640 1 --2- 172.21.15.133:0/3562707328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800bffd0 0x7fa580159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.713+0000 7fa57ed9d640 1 -- 172.21.15.133:0/3562707328 >> v1:172.21.15.133:6789/0 conn(0x7fa5800cb370 legacy=0x7fa580071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.713+0000 7fa57ed9d640 1 -- 172.21.15.133:0/3562707328 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580072b40 con 0x7fa5800cb750 2024-01-19T05:01:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.717+0000 7fa57ed9d640 1 --2- 172.21.15.133:0/3562707328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58015a440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa578009d90 tx=0x7fa57801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde6c06af92e3681 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa57d59a640 1 -- 172.21.15.133:0/3562707328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780af600 con 0x7fa5800cb750 2024-01-19T05:01:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa57d59a640 1 -- 172.21.15.133:0/3562707328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5780ab050 con 0x7fa5800cb750 2024-01-19T05:01:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa57d59a640 1 -- 172.21.15.133:0/3562707328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780af980 con 0x7fa5800cb750 2024-01-19T05:01:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 -- 172.21.15.133:0/3562707328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 msgr2=0x7fa58015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 --2- 172.21.15.133:0/3562707328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58015a440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa578009d90 tx=0x7fa57801f130 comp rx=0 tx=0).stop 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 -- 172.21.15.133:0/3562707328 shutdown_connections 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 --2- 172.21.15.133:0/3562707328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58015a440 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 --2- 172.21.15.133:0/3562707328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800bffd0 0x7fa580159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 -- 172.21.15.133:0/3562707328 >> 172.21.15.133:0/3562707328 conn(0x7fa58006d590 msgr2=0x7fa580066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 -- 172.21.15.133:0/3562707328 shutdown_connections 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.721+0000 7fa5848b7640 1 -- 172.21.15.133:0/3562707328 wait complete. 2024-01-19T05:01:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 Processor -- start 2024-01-19T05:01:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 -- start start 2024-01-19T05:01:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800bffd0 0x7fa5800c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800cb370 0x7fa5800c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58013c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5801f1300 con 0x7fa5800cb750 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580141d40 con 0x7fa5800bffd0 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa5848b7640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5801f1720 con 0x7fa5800cb370 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa57ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58013c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa57ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58013c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60704/0 (socket says 172.21.15.133:60704) 2024-01-19T05:01:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.725+0000 7fa57ed9d640 1 -- 172.21.15.133:0/533326122 learned_addr learned my addr 172.21.15.133:0/533326122 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:01:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.729+0000 7fa57ed9d640 1 -- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800cb370 msgr2=0x7fa5800c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.729+0000 7fa57ed9d640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800cb370 0x7fa5800c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.729+0000 7fa57ed9d640 1 -- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800bffd0 msgr2=0x7fa5800c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:01:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.729+0000 7fa57ed9d640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800bffd0 0x7fa5800c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:01:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.729+0000 7fa57ed9d640 1 -- 172.21.15.133:0/533326122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa578009a70 con 0x7fa5800cb750 2024-01-19T05:01:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.733+0000 7fa57ed9d640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58013c750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa57801d7e0 tx=0x7fa57801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.737+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780ba480 con 0x7fa5800cb750 2024-01-19T05:01:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.737+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5780ba5e0 con 0x7fa5800cb750 2024-01-19T05:01:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.737+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780ba970 con 0x7fa5800cb750 2024-01-19T05:01:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.737+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580141a60 con 0x7fa5800cb750 2024-01-19T05:01:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.737+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5801f0c40 con 0x7fa5800cb750 2024-01-19T05:01:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.737+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa580074340 con 0x7fa5800cb750 2024-01-19T05:01:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.757+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa5780b6040 con 0x7fa5800cb750 2024-01-19T05:01:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.757+0000 7fa56effd640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa560066550 0x7fa560068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:01:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.757+0000 7fa57e59c640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa560066550 0x7fa560068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:01:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.757+0000 7fa57e59c640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa560066550 0x7fa560068a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa570000f70 tx=0x7fa570007a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:01:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:01:59.757+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5780aee40 con 0x7fa5800cb750 2024-01-19T05:02:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.097+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa5780f0650 con 0x7fa5800cb750 2024-01-19T05:02:00.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.265+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5800c6240 con 0x7fa560066550 2024-01-19T05:02:00.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.293+0000 7fa56effd640 1 -- 172.21.15.133:0/533326122 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367946 (secure 0 0 0) 0x7fa5800c6240 con 0x7fa560066550 2024-01-19T05:02:00.294 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:02:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T05:02:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa560066550 msgr2=0x7fa560068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa560066550 0x7fa560068a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa570000f70 tx=0x7fa570007a90 comp rx=0 tx=0).stop 2024-01-19T05:02:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 msgr2=0x7fa58013c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58013c750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa57801d7e0 tx=0x7fa57801bed0 comp rx=0 tx=0).stop 2024-01-19T05:02:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 shutdown_connections 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa560066550 0x7fa560068a10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800cb750 0x7fa58013c750 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5800cb370 0x7fa5800c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 --2- 172.21.15.133:0/533326122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5800bffd0 0x7fa5800c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.297+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 >> 172.21.15.133:0/533326122 conn(0x7fa58006d590 msgr2=0x7fa58006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.301+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 shutdown_connections 2024-01-19T05:02:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:00.301+0000 7fa5848b7640 1 -- 172.21.15.133:0/533326122 wait complete. 2024-01-19T05:02:00.320 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":963,"stamp":"2024-01-19T05:01:58.418860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24694169,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":677,"num_read_kb":685,"num_write":8230,"num_write_kb":283324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9478,"ondisk_log_size":9478,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326848,"kb_used_data":51072,"kb_used_omap":12,"kb_used_meta":275699,"kb_avail":754647872,"statfs":{"total":773094113280,"available":772759420928,"internally_reserved":0,"allocated":52297728,"data_stored":50501458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":282316336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005459"},"pg_stats":[{"pgid":"2.1f","version":"31'652","reported_seq":696,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:53.926864+0000","last_change":"2024-01-19T05:01:53.926930+0000","last_active":"2024-01-19T05:01:53.926864+0000","last_peered":"2024-01-19T05:01:53.926864+0000","last_clean":"2024-01-19T05:01:53.926864+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T05:01:53.926864+0000","last_undegraded":"2024-01-19T05:01:53.926864+0000","last_fullsized":"2024-01-19T05:01:53.926864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'652","last_scrub_stamp":"2024-01-19T05:01:53.926791+0000","last_deep_scrub":"31'652","last_deep_scrub_stamp":"2024-01-19T05:01:53.926791+0000","last_clean_scrub_stamp":"2024-01-19T05:01:53.926791+0000","objects_scrubbed":7,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:31.638829+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.885215+0000","last_change":"2024-01-19T04:31:33.217082+0000","last_active":"2024-01-19T05:01:41.885215+0000","last_peered":"2024-01-19T05:01:41.885215+0000","last_clean":"2024-01-19T05:01:41.885215+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T05:01:41.885215+0000","last_undegraded":"2024-01-19T05:01:41.885215+0000","last_fullsized":"2024-01-19T05:01:41.885215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456294+0000","last_change":"2024-01-19T04:31:39.826638+0000","last_active":"2024-01-19T05:00:39.456294+0000","last_peered":"2024-01-19T05:00:39.456294+0000","last_clean":"2024-01-19T05:00:39.456294+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T05:00:39.456294+0000","last_undegraded":"2024-01-19T05:00:39.456294+0000","last_fullsized":"2024-01-19T05:00:39.456294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:29.242837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'262","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:42.127587+0000","last_change":"2024-01-19T04:31:31.776134+0000","last_active":"2024-01-19T05:01:42.127587+0000","last_peered":"2024-01-19T05:01:42.127587+0000","last_clean":"2024-01-19T05:01:42.127587+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T05:01:42.127587+0000","last_undegraded":"2024-01-19T05:01:42.127587+0000","last_fullsized":"2024-01-19T05:01:42.127587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2994311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'23","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891800+0000","last_change":"2024-01-19T04:31:33.252954+0000","last_active":"2024-01-19T05:01:41.891800+0000","last_peered":"2024-01-19T05:01:41.891800+0000","last_clean":"2024-01-19T05:01:41.891800+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T05:01:41.891800+0000","last_undegraded":"2024-01-19T05:01:41.891800+0000","last_fullsized":"2024-01-19T05:01:41.891800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'79","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.912319+0000","last_change":"2024-01-19T04:31:39.832580+0000","last_active":"2024-01-19T05:00:36.912319+0000","last_peered":"2024-01-19T05:00:36.912319+0000","last_clean":"2024-01-19T05:00:36.912319+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T05:00:36.912319+0000","last_undegraded":"2024-01-19T05:00:36.912319+0000","last_fullsized":"2024-01-19T05:00:36.912319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.459469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'16","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.961414+0000","last_change":"2024-01-19T04:31:31.830839+0000","last_active":"2024-01-19T05:01:21.961414+0000","last_peered":"2024-01-19T05:01:21.961414+0000","last_clean":"2024-01-19T05:01:21.961414+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T05:01:21.961414+0000","last_undegraded":"2024-01-19T05:01:21.961414+0000","last_fullsized":"2024-01-19T05:01:21.961414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:17.164709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'21","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.818570+0000","last_change":"2024-01-19T04:31:35.153315+0000","last_active":"2024-01-19T05:01:41.818570+0000","last_peered":"2024-01-19T05:01:41.818570+0000","last_clean":"2024-01-19T05:01:41.818570+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T05:01:41.818570+0000","last_undegraded":"2024-01-19T05:01:41.818570+0000","last_fullsized":"2024-01-19T05:01:41.818570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:16:33.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'86","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400126+0000","last_change":"2024-01-19T04:31:39.825718+0000","last_active":"2024-01-19T05:00:39.400126+0000","last_peered":"2024-01-19T05:00:39.400126+0000","last_clean":"2024-01-19T05:00:39.400126+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T05:00:39.400126+0000","last_undegraded":"2024-01-19T05:00:39.400126+0000","last_fullsized":"2024-01-19T05:00:39.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:27.159984+0000","last_change":"2024-01-19T04:31:31.798742+0000","last_active":"2024-01-19T05:01:27.159984+0000","last_peered":"2024-01-19T05:01:27.159984+0000","last_clean":"2024-01-19T05:01:27.159984+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T05:01:27.159984+0000","last_undegraded":"2024-01-19T05:01:27.159984+0000","last_fullsized":"2024-01-19T05:01:27.159984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:00.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.808509+0000","last_change":"2024-01-19T04:31:35.153903+0000","last_active":"2024-01-19T05:01:41.808509+0000","last_peered":"2024-01-19T05:01:41.808509+0000","last_clean":"2024-01-19T05:01:41.808509+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T05:01:41.808509+0000","last_undegraded":"2024-01-19T05:01:41.808509+0000","last_fullsized":"2024-01-19T05:01:41.808509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:31.753834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'85","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:37.439380+0000","last_change":"2024-01-19T04:31:39.822267+0000","last_active":"2024-01-19T05:00:37.439380+0000","last_peered":"2024-01-19T05:00:37.439380+0000","last_clean":"2024-01-19T05:00:37.439380+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T05:00:37.439380+0000","last_undegraded":"2024-01-19T05:00:37.439380+0000","last_fullsized":"2024-01-19T05:00:37.439380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:11.636017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983091+0000","last_change":"2024-01-19T04:31:33.219895+0000","last_active":"2024-01-19T05:01:41.983091+0000","last_peered":"2024-01-19T05:01:41.983091+0000","last_clean":"2024-01-19T05:01:41.983091+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T05:01:41.983091+0000","last_undegraded":"2024-01-19T05:01:41.983091+0000","last_fullsized":"2024-01-19T05:01:41.983091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'676","reported_seq":711,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:25.018447+0000","last_change":"2024-01-19T04:31:31.808089+0000","last_active":"2024-01-19T05:01:25.018447+0000","last_peered":"2024-01-19T05:01:25.018447+0000","last_clean":"2024-01-19T05:01:25.018447+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T05:01:25.018447+0000","last_undegraded":"2024-01-19T05:01:25.018447+0000","last_fullsized":"2024-01-19T05:01:25.018447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:56:36.678857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'66","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:35.377800+0000","last_change":"2024-01-19T04:32:37.510574+0000","last_active":"2024-01-19T05:00:35.377800+0000","last_peered":"2024-01-19T05:00:35.377800+0000","last_clean":"2024-01-19T05:00:35.377800+0000","last_became_active":"2024-01-19T04:32:37.509981+0000","last_became_peered":"2024-01-19T04:32:37.509981+0000","last_unstale":"2024-01-19T05:00:35.377800+0000","last_undegraded":"2024-01-19T05:00:35.377800+0000","last_fullsized":"2024-01-19T05:00:35.377800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:57:44.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895522+0000","last_change":"2024-01-19T04:31:33.154750+0000","last_active":"2024-01-19T05:01:41.895522+0000","last_peered":"2024-01-19T05:01:41.895522+0000","last_clean":"2024-01-19T05:01:41.895522+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T05:01:41.895522+0000","last_undegraded":"2024-01-19T05:01:41.895522+0000","last_fullsized":"2024-01-19T05:01:41.895522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:29:11.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:37.466408+0000","last_change":"2024-01-19T04:31:31.807587+0000","last_active":"2024-01-19T05:01:37.466408+0000","last_peered":"2024-01-19T05:01:37.466408+0000","last_clean":"2024-01-19T05:01:37.466408+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T05:01:37.466408+0000","last_undegraded":"2024-01-19T05:01:37.466408+0000","last_fullsized":"2024-01-19T05:01:37.466408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'75","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:36.777943+0000","last_change":"2024-01-19T04:31:39.834567+0000","last_active":"2024-01-19T05:00:36.777943+0000","last_peered":"2024-01-19T05:00:36.777943+0000","last_clean":"2024-01-19T05:00:36.777943+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T05:00:36.777943+0000","last_undegraded":"2024-01-19T05:00:36.777943+0000","last_fullsized":"2024-01-19T05:00:36.777943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:14.723557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.889136+0000","last_change":"2024-01-19T04:31:33.151194+0000","last_active":"2024-01-19T05:01:41.889136+0000","last_peered":"2024-01-19T05:01:41.889136+0000","last_clean":"2024-01-19T05:01:41.889136+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T05:01:41.889136+0000","last_undegraded":"2024-01-19T05:01:41.889136+0000","last_fullsized":"2024-01-19T05:01:41.889136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'9","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:53.721362+0000","last_change":"2024-01-19T04:31:31.804191+0000","last_active":"2024-01-19T05:01:53.721362+0000","last_peered":"2024-01-19T05:01:53.721362+0000","last_clean":"2024-01-19T05:01:53.721362+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T05:01:53.721362+0000","last_undegraded":"2024-01-19T05:01:53.721362+0000","last_fullsized":"2024-01-19T05:01:53.721362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'84","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:00.163582+0000","last_change":"2024-01-19T04:31:39.831300+0000","last_active":"2024-01-19T05:01:00.163582+0000","last_peered":"2024-01-19T05:01:00.163582+0000","last_clean":"2024-01-19T05:01:00.163582+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T05:01:00.163582+0000","last_undegraded":"2024-01-19T05:01:00.163582+0000","last_fullsized":"2024-01-19T05:01:00.163582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'24","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.690183+0000","last_change":"2024-01-19T04:31:33.071584+0000","last_active":"2024-01-19T05:01:41.690183+0000","last_peered":"2024-01-19T05:01:41.690183+0000","last_clean":"2024-01-19T05:01:41.690183+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T05:01:41.690183+0000","last_undegraded":"2024-01-19T05:01:41.690183+0000","last_fullsized":"2024-01-19T05:01:41.690183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:42.015807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.961027+0000","last_change":"2024-01-19T04:31:31.775540+0000","last_active":"2024-01-19T05:01:21.961027+0000","last_peered":"2024-01-19T05:01:21.961027+0000","last_clean":"2024-01-19T05:01:21.961027+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T05:01:21.961027+0000","last_undegraded":"2024-01-19T05:01:21.961027+0000","last_fullsized":"2024-01-19T05:01:21.961027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:59:37.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'64","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.178229+0000","last_change":"2024-01-19T04:32:37.173175+0000","last_active":"2024-01-19T05:00:40.178229+0000","last_peered":"2024-01-19T05:00:40.178229+0000","last_clean":"2024-01-19T05:00:40.178229+0000","last_became_active":"2024-01-19T04:32:37.172049+0000","last_became_peered":"2024-01-19T04:32:37.172049+0000","last_unstale":"2024-01-19T05:00:40.178229+0000","last_undegraded":"2024-01-19T05:00:40.178229+0000","last_fullsized":"2024-01-19T05:00:40.178229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:44:06.445358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'30","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:52.627203+0000","last_change":"2024-01-19T04:31:33.034848+0000","last_active":"2024-01-19T05:01:52.627203+0000","last_peered":"2024-01-19T05:01:52.627203+0000","last_clean":"2024-01-19T05:01:52.627203+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T05:01:52.627203+0000","last_undegraded":"2024-01-19T05:01:52.627203+0000","last_fullsized":"2024-01-19T05:01:52.627203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'14","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:34.280616+0000","last_change":"2024-01-19T04:31:31.835681+0000","last_active":"2024-01-19T05:01:34.280616+0000","last_peered":"2024-01-19T05:01:34.280616+0000","last_clean":"2024-01-19T05:01:34.280616+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T05:01:34.280616+0000","last_undegraded":"2024-01-19T05:01:34.280616+0000","last_fullsized":"2024-01-19T05:01:34.280616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:04:59.088279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'70","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.078499+0000","last_change":"2024-01-19T04:31:39.815720+0000","last_active":"2024-01-19T05:00:39.078499+0000","last_peered":"2024-01-19T05:00:39.078499+0000","last_clean":"2024-01-19T05:00:39.078499+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T05:00:39.078499+0000","last_undegraded":"2024-01-19T05:00:39.078499+0000","last_fullsized":"2024-01-19T05:00:39.078499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:10.753795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'20","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.884536+0000","last_change":"2024-01-19T04:31:33.151255+0000","last_active":"2024-01-19T05:01:41.884536+0000","last_peered":"2024-01-19T05:01:41.884536+0000","last_clean":"2024-01-19T05:01:41.884536+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T05:01:41.884536+0000","last_undegraded":"2024-01-19T05:01:41.884536+0000","last_fullsized":"2024-01-19T05:01:41.884536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'338","reported_seq":374,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:53.721337+0000","last_change":"2024-01-19T04:31:31.832361+0000","last_active":"2024-01-19T05:01:53.721337+0000","last_peered":"2024-01-19T05:01:53.721337+0000","last_clean":"2024-01-19T05:01:53.721337+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T05:01:53.721337+0000","last_undegraded":"2024-01-19T05:01:53.721337+0000","last_fullsized":"2024-01-19T05:01:53.721337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":914,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.977879+0000","last_change":"2024-01-19T04:31:39.829836+0000","last_active":"2024-01-19T05:00:39.977879+0000","last_peered":"2024-01-19T05:00:39.977879+0000","last_clean":"2024-01-19T05:00:39.977879+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T05:00:39.977879+0000","last_undegraded":"2024-01-19T05:00:39.977879+0000","last_fullsized":"2024-01-19T05:00:39.977879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:54.385357+0000","last_change":"2024-01-19T05:01:54.385377+0000","last_active":"2024-01-19T05:01:54.385357+0000","last_peered":"2024-01-19T05:01:54.385357+0000","last_clean":"2024-01-19T05:01:54.385357+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T05:01:54.385357+0000","last_undegraded":"2024-01-19T05:01:54.385357+0000","last_fullsized":"2024-01-19T05:01:54.385357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-01-19T05:01:54.385297+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-01-19T05:01:54.385297+0000","last_clean_scrub_stamp":"2024-01-19T05:01:54.385297+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:12:42.804116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'7","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:22.945763+0000","last_change":"2024-01-19T04:31:31.776531+0000","last_active":"2024-01-19T05:01:22.945763+0000","last_peered":"2024-01-19T05:01:22.945763+0000","last_clean":"2024-01-19T05:01:22.945763+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T05:01:22.945763+0000","last_undegraded":"2024-01-19T05:01:22.945763+0000","last_fullsized":"2024-01-19T05:01:22.945763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:33:36.288622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'70","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:51.738800+0000","last_change":"2024-01-19T04:31:39.821866+0000","last_active":"2024-01-19T05:00:51.738800+0000","last_peered":"2024-01-19T05:00:51.738800+0000","last_clean":"2024-01-19T05:00:51.738800+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T05:00:51.738800+0000","last_undegraded":"2024-01-19T05:00:51.738800+0000","last_fullsized":"2024-01-19T05:00:51.738800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'19","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.992505+0000","last_change":"2024-01-19T04:32:36.019089+0000","last_active":"2024-01-19T05:01:41.992505+0000","last_peered":"2024-01-19T05:01:41.992505+0000","last_clean":"2024-01-19T05:01:41.992505+0000","last_became_active":"2024-01-19T04:32:36.018566+0000","last_became_peered":"2024-01-19T04:32:36.018566+0000","last_unstale":"2024-01-19T05:01:41.992505+0000","last_undegraded":"2024-01-19T05:01:41.992505+0000","last_fullsized":"2024-01-19T05:01:41.992505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:21.955405+0000","last_change":"2024-01-19T04:31:31.807964+0000","last_active":"2024-01-19T05:01:21.955405+0000","last_peered":"2024-01-19T05:01:21.955405+0000","last_clean":"2024-01-19T05:01:21.955405+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T05:01:21.955405+0000","last_undegraded":"2024-01-19T05:01:21.955405+0000","last_fullsized":"2024-01-19T05:01:21.955405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'99","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:50.161731+0000","last_change":"2024-01-19T04:31:39.834513+0000","last_active":"2024-01-19T05:00:50.161731+0000","last_peered":"2024-01-19T05:00:50.161731+0000","last_clean":"2024-01-19T05:00:50.161731+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T05:00:50.161731+0000","last_undegraded":"2024-01-19T05:00:50.161731+0000","last_fullsized":"2024-01-19T05:00:50.161731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'21","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.690377+0000","last_change":"2024-01-19T04:31:33.041390+0000","last_active":"2024-01-19T05:01:41.690377+0000","last_peered":"2024-01-19T05:01:41.690377+0000","last_clean":"2024-01-19T05:01:41.690377+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T05:01:41.690377+0000","last_undegraded":"2024-01-19T05:01:41.690377+0000","last_fullsized":"2024-01-19T05:01:41.690377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.877947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.002220+0000","last_change":"2024-01-19T04:31:31.804310+0000","last_active":"2024-01-19T05:01:01.002220+0000","last_peered":"2024-01-19T05:01:01.002220+0000","last_clean":"2024-01-19T05:01:01.002220+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T05:01:01.002220+0000","last_undegraded":"2024-01-19T05:01:01.002220+0000","last_fullsized":"2024-01-19T05:01:01.002220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:47.327687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'56","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:50.161755+0000","last_change":"2024-01-19T04:31:39.830618+0000","last_active":"2024-01-19T05:00:50.161755+0000","last_peered":"2024-01-19T05:00:50.161755+0000","last_clean":"2024-01-19T05:00:50.161755+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T05:00:50.161755+0000","last_undegraded":"2024-01-19T05:00:50.161755+0000","last_fullsized":"2024-01-19T05:00:50.161755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'25","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.670418+0000","last_change":"2024-01-19T04:31:34.850241+0000","last_active":"2024-01-19T05:01:41.670418+0000","last_peered":"2024-01-19T05:01:41.670418+0000","last_clean":"2024-01-19T05:01:41.670418+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T05:01:41.670418+0000","last_undegraded":"2024-01-19T05:01:41.670418+0000","last_fullsized":"2024-01-19T05:01:41.670418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'571","reported_seq":1168,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.389300+0000","last_change":"2024-01-19T04:31:31.731793+0000","last_active":"2024-01-19T05:01:41.389300+0000","last_peered":"2024-01-19T05:01:41.389300+0000","last_clean":"2024-01-19T05:01:41.389300+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T05:01:41.389300+0000","last_undegraded":"2024-01-19T05:01:41.389300+0000","last_fullsized":"2024-01-19T05:01:41.389300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129245,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":569,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'65","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.053753+0000","last_change":"2024-01-19T04:31:39.836886+0000","last_active":"2024-01-19T05:00:40.053753+0000","last_peered":"2024-01-19T05:00:40.053753+0000","last_clean":"2024-01-19T05:00:40.053753+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T05:00:40.053753+0000","last_undegraded":"2024-01-19T05:00:40.053753+0000","last_fullsized":"2024-01-19T05:00:40.053753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":6769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'15","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.890804+0000","last_change":"2024-01-19T04:31:33.040081+0000","last_active":"2024-01-19T05:01:41.890804+0000","last_peered":"2024-01-19T05:01:41.890804+0000","last_clean":"2024-01-19T05:01:41.890804+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T05:01:41.890804+0000","last_undegraded":"2024-01-19T05:01:41.890804+0000","last_fullsized":"2024-01-19T05:01:41.890804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.385654+0000","last_change":"2024-01-19T04:31:31.802270+0000","last_active":"2024-01-19T05:01:31.385654+0000","last_peered":"2024-01-19T05:01:31.385654+0000","last_clean":"2024-01-19T05:01:31.385654+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T05:01:31.385654+0000","last_undegraded":"2024-01-19T05:01:31.385654+0000","last_fullsized":"2024-01-19T05:01:31.385654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:56:33.935177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'104","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456593+0000","last_change":"2024-01-19T04:31:39.820785+0000","last_active":"2024-01-19T05:00:39.456593+0000","last_peered":"2024-01-19T05:00:39.456593+0000","last_clean":"2024-01-19T05:00:39.456593+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T05:00:39.456593+0000","last_undegraded":"2024-01-19T05:00:39.456593+0000","last_fullsized":"2024-01-19T05:00:39.456593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":11574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'22","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.878545+0000","last_change":"2024-01-19T04:31:33.249857+0000","last_active":"2024-01-19T05:01:41.878545+0000","last_peered":"2024-01-19T05:01:41.878545+0000","last_clean":"2024-01-19T05:01:41.878545+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T05:01:41.878545+0000","last_undegraded":"2024-01-19T05:01:41.878545+0000","last_fullsized":"2024-01-19T05:01:41.878545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:51.495665+0000","last_change":"2024-01-19T04:31:31.801682+0000","last_active":"2024-01-19T05:00:51.495665+0000","last_peered":"2024-01-19T05:00:51.495665+0000","last_clean":"2024-01-19T05:00:51.495665+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T05:00:51.495665+0000","last_undegraded":"2024-01-19T05:00:51.495665+0000","last_fullsized":"2024-01-19T05:00:51.495665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:58.795103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T04:58:56.813272+0000","last_change":"2024-01-19T04:30:49.975611+0000","last_active":"2024-01-19T04:58:56.813272+0000","last_peered":"2024-01-19T04:58:56.813272+0000","last_clean":"2024-01-19T04:58:56.813272+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T04:58:56.813272+0000","last_undegraded":"2024-01-19T04:58:56.813272+0000","last_fullsized":"2024-01-19T04:58:56.813272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:30:46.763072+0000","last_clean_scrub_stamp":"2024-01-19T04:30:46.763072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:23.255255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.104947+0000","last_change":"2024-01-19T04:31:39.830874+0000","last_active":"2024-01-19T05:00:40.104947+0000","last_peered":"2024-01-19T05:00:40.104947+0000","last_clean":"2024-01-19T05:00:40.104947+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T05:00:40.104947+0000","last_undegraded":"2024-01-19T05:00:40.104947+0000","last_fullsized":"2024-01-19T05:00:40.104947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'24","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815761+0000","last_change":"2024-01-19T04:31:33.248652+0000","last_active":"2024-01-19T05:01:41.815761+0000","last_peered":"2024-01-19T05:01:41.815761+0000","last_clean":"2024-01-19T05:01:41.815761+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T05:01:41.815761+0000","last_undegraded":"2024-01-19T05:01:41.815761+0000","last_fullsized":"2024-01-19T05:01:41.815761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:54.251126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'12","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.380069+0000","last_change":"2024-01-19T04:31:31.802253+0000","last_active":"2024-01-19T05:01:41.380069+0000","last_peered":"2024-01-19T05:01:41.380069+0000","last_clean":"2024-01-19T05:01:41.380069+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T05:01:41.380069+0000","last_undegraded":"2024-01-19T05:01:41.380069+0000","last_fullsized":"2024-01-19T05:01:41.380069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'80","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:22.079775+0000","last_change":"2024-01-19T04:31:39.831025+0000","last_active":"2024-01-19T05:00:22.079775+0000","last_peered":"2024-01-19T05:00:22.079775+0000","last_clean":"2024-01-19T05:00:22.079775+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T05:00:22.079775+0000","last_undegraded":"2024-01-19T05:00:22.079775+0000","last_fullsized":"2024-01-19T05:00:22.079775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:12:29.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'22","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.705546+0000","last_change":"2024-01-19T04:32:36.982936+0000","last_active":"2024-01-19T05:01:41.705546+0000","last_peered":"2024-01-19T05:01:41.705546+0000","last_clean":"2024-01-19T05:01:41.705546+0000","last_became_active":"2024-01-19T04:32:36.982330+0000","last_became_peered":"2024-01-19T04:32:36.982330+0000","last_unstale":"2024-01-19T05:01:41.705546+0000","last_undegraded":"2024-01-19T05:01:41.705546+0000","last_fullsized":"2024-01-19T05:01:41.705546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:39.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:28.068922+0000","last_change":"2024-01-19T04:31:31.802243+0000","last_active":"2024-01-19T05:01:28.068922+0000","last_peered":"2024-01-19T05:01:28.068922+0000","last_clean":"2024-01-19T05:01:28.068922+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T05:01:28.068922+0000","last_undegraded":"2024-01-19T05:01:28.068922+0000","last_fullsized":"2024-01-19T05:01:28.068922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'75","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:56.739757+0000","last_change":"2024-01-19T04:31:39.821991+0000","last_active":"2024-01-19T05:00:56.739757+0000","last_peered":"2024-01-19T05:00:56.739757+0000","last_clean":"2024-01-19T05:00:56.739757+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T05:00:56.739757+0000","last_undegraded":"2024-01-19T05:00:56.739757+0000","last_fullsized":"2024-01-19T05:00:56.739757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":9598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.819246+0000","last_change":"2024-01-19T04:31:33.038538+0000","last_active":"2024-01-19T05:01:41.819246+0000","last_peered":"2024-01-19T05:01:41.819246+0000","last_clean":"2024-01-19T05:01:41.819246+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T05:01:41.819246+0000","last_undegraded":"2024-01-19T05:01:41.819246+0000","last_fullsized":"2024-01-19T05:01:41.819246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:35:45.844537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.404574+0000","last_change":"2024-01-19T04:31:31.731951+0000","last_active":"2024-01-19T05:01:31.404574+0000","last_peered":"2024-01-19T05:01:31.404574+0000","last_clean":"2024-01-19T05:01:31.404574+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T05:01:31.404574+0000","last_undegraded":"2024-01-19T05:01:31.404574+0000","last_fullsized":"2024-01-19T05:01:31.404574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:29.016220+0000","last_change":"2024-01-19T04:31:39.821395+0000","last_active":"2024-01-19T05:00:29.016220+0000","last_peered":"2024-01-19T05:00:29.016220+0000","last_clean":"2024-01-19T05:00:29.016220+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T05:00:29.016220+0000","last_undegraded":"2024-01-19T05:00:29.016220+0000","last_fullsized":"2024-01-19T05:00:29.016220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":7505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.801564+0000","last_change":"2024-01-19T04:31:33.039088+0000","last_active":"2024-01-19T05:01:41.801564+0000","last_peered":"2024-01-19T05:01:41.801564+0000","last_clean":"2024-01-19T05:01:41.801564+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T05:01:41.801564+0000","last_undegraded":"2024-01-19T05:01:41.801564+0000","last_fullsized":"2024-01-19T05:01:41.801564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:57.448041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:01.025179+0000","last_change":"2024-01-19T04:31:31.807918+0000","last_active":"2024-01-19T05:01:01.025179+0000","last_peered":"2024-01-19T05:01:01.025179+0000","last_clean":"2024-01-19T05:01:01.025179+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T05:01:01.025179+0000","last_undegraded":"2024-01-19T05:01:01.025179+0000","last_fullsized":"2024-01-19T05:01:01.025179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:48.307201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'111","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.227926+0000","last_change":"2024-01-19T04:31:39.836839+0000","last_active":"2024-01-19T05:00:39.227926+0000","last_peered":"2024-01-19T05:00:39.227926+0000","last_clean":"2024-01-19T05:00:39.227926+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T05:00:39.227926+0000","last_undegraded":"2024-01-19T05:00:39.227926+0000","last_fullsized":"2024-01-19T05:00:39.227926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:00:38.695836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.821023+0000","last_change":"2024-01-19T04:31:33.043623+0000","last_active":"2024-01-19T05:01:41.821023+0000","last_peered":"2024-01-19T05:01:41.821023+0000","last_clean":"2024-01-19T05:01:41.821023+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T05:01:41.821023+0000","last_undegraded":"2024-01-19T05:01:41.821023+0000","last_fullsized":"2024-01-19T05:01:41.821023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:39:57.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'19","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:54.566963+0000","last_change":"2024-01-19T04:31:31.800886+0000","last_active":"2024-01-19T05:01:54.566963+0000","last_peered":"2024-01-19T05:01:54.566963+0000","last_clean":"2024-01-19T05:01:54.566963+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T05:01:54.566963+0000","last_undegraded":"2024-01-19T05:01:54.566963+0000","last_fullsized":"2024-01-19T05:01:54.566963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'79","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:41.876781+0000","last_change":"2024-01-19T04:31:39.823077+0000","last_active":"2024-01-19T05:00:41.876781+0000","last_peered":"2024-01-19T05:00:41.876781+0000","last_clean":"2024-01-19T05:00:41.876781+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T05:00:41.876781+0000","last_undegraded":"2024-01-19T05:00:41.876781+0000","last_fullsized":"2024-01-19T05:00:41.876781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.913991+0000","last_change":"2024-01-19T04:31:33.215354+0000","last_active":"2024-01-19T05:01:41.913991+0000","last_peered":"2024-01-19T05:01:41.913991+0000","last_clean":"2024-01-19T05:01:41.913991+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T05:01:41.913991+0000","last_undegraded":"2024-01-19T05:01:41.913991+0000","last_fullsized":"2024-01-19T05:01:41.913991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'13","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.386984+0000","last_change":"2024-01-19T04:31:31.836681+0000","last_active":"2024-01-19T05:01:41.386984+0000","last_peered":"2024-01-19T05:01:41.386984+0000","last_clean":"2024-01-19T05:01:41.386984+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T05:01:41.386984+0000","last_undegraded":"2024-01-19T05:01:41.386984+0000","last_fullsized":"2024-01-19T05:01:41.386984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'73","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.456178+0000","last_change":"2024-01-19T04:32:37.173262+0000","last_active":"2024-01-19T05:00:39.456178+0000","last_peered":"2024-01-19T05:00:39.456178+0000","last_clean":"2024-01-19T05:00:39.456178+0000","last_became_active":"2024-01-19T04:32:37.172443+0000","last_became_peered":"2024-01-19T04:32:37.172443+0000","last_unstale":"2024-01-19T05:00:39.456178+0000","last_undegraded":"2024-01-19T05:00:39.456178+0000","last_fullsized":"2024-01-19T05:00:39.456178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:47.286856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.822522+0000","last_change":"2024-01-19T04:31:33.039389+0000","last_active":"2024-01-19T05:01:41.822522+0000","last_peered":"2024-01-19T05:01:41.822522+0000","last_clean":"2024-01-19T05:01:41.822522+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T05:01:41.822522+0000","last_undegraded":"2024-01-19T05:01:41.822522+0000","last_fullsized":"2024-01-19T05:01:41.822522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:42:31.105415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'12","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:33.273859+0000","last_change":"2024-01-19T04:31:31.803961+0000","last_active":"2024-01-19T05:01:33.273859+0000","last_peered":"2024-01-19T05:01:33.273859+0000","last_clean":"2024-01-19T05:01:33.273859+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T05:01:33.273859+0000","last_undegraded":"2024-01-19T05:01:33.273859+0000","last_fullsized":"2024-01-19T05:01:33.273859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:15.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'64","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.991388+0000","last_change":"2024-01-19T04:31:39.829351+0000","last_active":"2024-01-19T05:00:39.991388+0000","last_peered":"2024-01-19T05:00:39.991388+0000","last_clean":"2024-01-19T05:00:39.991388+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T05:00:39.991388+0000","last_undegraded":"2024-01-19T05:00:39.991388+0000","last_fullsized":"2024-01-19T05:00:39.991388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:24.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'26","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:52.627178+0000","last_change":"2024-01-19T04:31:32.994080+0000","last_active":"2024-01-19T05:01:52.627178+0000","last_peered":"2024-01-19T05:01:52.627178+0000","last_clean":"2024-01-19T05:01:52.627178+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T05:01:52.627178+0000","last_undegraded":"2024-01-19T05:01:52.627178+0000","last_fullsized":"2024-01-19T05:01:52.627178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:54.942037+0000","last_change":"2024-01-19T05:01:54.942066+0000","last_active":"2024-01-19T05:01:54.942037+0000","last_peered":"2024-01-19T05:01:54.942037+0000","last_clean":"2024-01-19T05:01:54.942037+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T05:01:54.942037+0000","last_undegraded":"2024-01-19T05:01:54.942037+0000","last_fullsized":"2024-01-19T05:01:54.942037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-01-19T05:01:54.941974+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-01-19T05:01:54.941974+0000","last_clean_scrub_stamp":"2024-01-19T05:01:54.941974+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:10:13.187545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'85","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.190851+0000","last_change":"2024-01-19T04:31:39.827792+0000","last_active":"2024-01-19T05:00:39.190851+0000","last_peered":"2024-01-19T05:00:39.190851+0000","last_clean":"2024-01-19T05:00:39.190851+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T05:00:39.190851+0000","last_undegraded":"2024-01-19T05:00:39.190851+0000","last_fullsized":"2024-01-19T05:00:39.190851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.781396+0000","last_change":"2024-01-19T04:31:33.150134+0000","last_active":"2024-01-19T05:01:41.781396+0000","last_peered":"2024-01-19T05:01:41.781396+0000","last_clean":"2024-01-19T05:01:41.781396+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T05:01:41.781396+0000","last_undegraded":"2024-01-19T05:01:41.781396+0000","last_fullsized":"2024-01-19T05:01:41.781396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:44.558104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'830","reported_seq":864,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:23.910166+0000","last_change":"2024-01-19T04:31:31.836078+0000","last_active":"2024-01-19T05:01:23.910166+0000","last_peered":"2024-01-19T05:01:23.910166+0000","last_clean":"2024-01-19T05:01:23.910166+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T05:01:23.910166+0000","last_undegraded":"2024-01-19T05:01:23.910166+0000","last_fullsized":"2024-01-19T05:01:23.910166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":4574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'77","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.549620+0000","last_change":"2024-01-19T04:31:39.823478+0000","last_active":"2024-01-19T05:00:39.549620+0000","last_peered":"2024-01-19T05:00:39.549620+0000","last_clean":"2024-01-19T05:00:39.549620+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T05:00:39.549620+0000","last_undegraded":"2024-01-19T05:00:39.549620+0000","last_fullsized":"2024-01-19T05:00:39.549620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'25","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706189+0000","last_change":"2024-01-19T04:31:33.044023+0000","last_active":"2024-01-19T05:01:41.706189+0000","last_peered":"2024-01-19T05:01:41.706189+0000","last_clean":"2024-01-19T05:01:41.706189+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T05:01:41.706189+0000","last_undegraded":"2024-01-19T05:01:41.706189+0000","last_fullsized":"2024-01-19T05:01:41.706189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:16.582688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'388","reported_seq":422,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:36.798550+0000","last_change":"2024-01-19T04:31:31.806538+0000","last_active":"2024-01-19T05:01:36.798550+0000","last_peered":"2024-01-19T05:01:36.798550+0000","last_clean":"2024-01-19T05:01:36.798550+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T05:01:36.798550+0000","last_undegraded":"2024-01-19T05:01:36.798550+0000","last_fullsized":"2024-01-19T05:01:36.798550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'136","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.453507+0000","last_change":"2024-01-19T04:31:39.825159+0000","last_active":"2024-01-19T05:00:39.453507+0000","last_peered":"2024-01-19T05:00:39.453507+0000","last_clean":"2024-01-19T05:00:39.453507+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T05:00:39.453507+0000","last_undegraded":"2024-01-19T05:00:39.453507+0000","last_fullsized":"2024-01-19T05:00:39.453507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:55.118209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'27","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.891336+0000","last_change":"2024-01-19T04:31:33.249232+0000","last_active":"2024-01-19T05:01:41.891336+0000","last_peered":"2024-01-19T05:01:41.891336+0000","last_clean":"2024-01-19T05:01:41.891336+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T05:01:41.891336+0000","last_undegraded":"2024-01-19T05:01:41.891336+0000","last_fullsized":"2024-01-19T05:01:41.891336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:02.941137+0000","last_change":"2024-01-19T04:31:31.833014+0000","last_active":"2024-01-19T05:01:02.941137+0000","last_peered":"2024-01-19T05:01:02.941137+0000","last_clean":"2024-01-19T05:01:02.941137+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T05:01:02.941137+0000","last_undegraded":"2024-01-19T05:01:02.941137+0000","last_fullsized":"2024-01-19T05:01:02.941137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:28:19.930447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'77","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:26.451904+0000","last_change":"2024-01-19T04:31:39.826194+0000","last_active":"2024-01-19T05:00:26.451904+0000","last_peered":"2024-01-19T05:00:26.451904+0000","last_clean":"2024-01-19T05:00:26.451904+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T05:00:26.451904+0000","last_undegraded":"2024-01-19T05:00:26.451904+0000","last_fullsized":"2024-01-19T05:00:26.451904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:35:40.215255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.810961+0000","last_change":"2024-01-19T04:31:34.744081+0000","last_active":"2024-01-19T05:01:41.810961+0000","last_peered":"2024-01-19T05:01:41.810961+0000","last_clean":"2024-01-19T05:01:41.810961+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T05:01:41.810961+0000","last_undegraded":"2024-01-19T05:01:41.810961+0000","last_fullsized":"2024-01-19T05:01:41.810961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:11.962224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'17","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.378730+0000","last_change":"2024-01-19T04:31:31.839030+0000","last_active":"2024-01-19T05:01:41.378730+0000","last_peered":"2024-01-19T05:01:41.378730+0000","last_clean":"2024-01-19T05:01:41.378730+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T05:01:41.378730+0000","last_undegraded":"2024-01-19T05:01:41.378730+0000","last_fullsized":"2024-01-19T05:01:41.378730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:42.313171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'83","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:16.414257+0000","last_change":"2024-01-19T04:31:39.830292+0000","last_active":"2024-01-19T05:00:16.414257+0000","last_peered":"2024-01-19T05:00:16.414257+0000","last_clean":"2024-01-19T05:00:16.414257+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T05:00:16.414257+0000","last_undegraded":"2024-01-19T05:00:16.414257+0000","last_fullsized":"2024-01-19T05:00:16.414257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:19:14.857614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'74","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:51.749258+0000","last_change":"2024-01-19T04:31:39.827342+0000","last_active":"2024-01-19T05:01:51.749258+0000","last_peered":"2024-01-19T05:01:51.749258+0000","last_clean":"2024-01-19T05:01:51.749258+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T05:01:51.749258+0000","last_undegraded":"2024-01-19T05:01:51.749258+0000","last_fullsized":"2024-01-19T05:01:51.749258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.673030+0000","last_change":"2024-01-19T04:31:34.847353+0000","last_active":"2024-01-19T05:01:41.673030+0000","last_peered":"2024-01-19T05:01:41.673030+0000","last_clean":"2024-01-19T05:01:41.673030+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T05:01:41.673030+0000","last_undegraded":"2024-01-19T05:01:41.673030+0000","last_fullsized":"2024-01-19T05:01:41.673030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:31.300615+0000","last_change":"2024-01-19T04:31:31.802895+0000","last_active":"2024-01-19T05:01:31.300615+0000","last_peered":"2024-01-19T05:01:31.300615+0000","last_clean":"2024-01-19T05:01:31.300615+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T05:01:31.300615+0000","last_undegraded":"2024-01-19T05:01:31.300615+0000","last_fullsized":"2024-01-19T05:01:31.300615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:30.211265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'86","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:40.056917+0000","last_change":"2024-01-19T04:31:39.836429+0000","last_active":"2024-01-19T05:00:40.056917+0000","last_peered":"2024-01-19T05:00:40.056917+0000","last_clean":"2024-01-19T05:00:40.056917+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T05:00:40.056917+0000","last_undegraded":"2024-01-19T05:00:40.056917+0000","last_fullsized":"2024-01-19T05:00:40.056917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:57.932725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":13922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892111+0000","last_change":"2024-01-19T04:31:33.151824+0000","last_active":"2024-01-19T05:01:41.892111+0000","last_peered":"2024-01-19T05:01:41.892111+0000","last_clean":"2024-01-19T05:01:41.892111+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T05:01:41.892111+0000","last_undegraded":"2024-01-19T05:01:41.892111+0000","last_fullsized":"2024-01-19T05:01:41.892111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'4","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.109280+0000","last_change":"2024-01-19T04:31:31.833792+0000","last_active":"2024-01-19T05:00:39.109280+0000","last_peered":"2024-01-19T05:00:39.109280+0000","last_clean":"2024-01-19T05:00:39.109280+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T05:00:39.109280+0000","last_undegraded":"2024-01-19T05:00:39.109280+0000","last_fullsized":"2024-01-19T05:00:39.109280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:17.473542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'646","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:16.645553+0000","last_change":"2024-01-19T04:31:31.839488+0000","last_active":"2024-01-19T05:01:16.645553+0000","last_peered":"2024-01-19T05:01:16.645553+0000","last_clean":"2024-01-19T05:01:16.645553+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T05:01:16.645553+0000","last_undegraded":"2024-01-19T05:01:16.645553+0000","last_fullsized":"2024-01-19T05:01:16.645553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:35:35.878242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'25","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.899583+0000","last_change":"2024-01-19T04:31:33.039873+0000","last_active":"2024-01-19T05:01:41.899583+0000","last_peered":"2024-01-19T05:01:41.899583+0000","last_clean":"2024-01-19T05:01:41.899583+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T05:01:41.899583+0000","last_undegraded":"2024-01-19T05:01:41.899583+0000","last_fullsized":"2024-01-19T05:01:41.899583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'47","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:39.970291+0000","last_change":"2024-01-19T04:31:39.835539+0000","last_active":"2024-01-19T05:01:39.970291+0000","last_peered":"2024-01-19T05:01:39.970291+0000","last_clean":"2024-01-19T05:01:39.970291+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T05:01:39.970291+0000","last_undegraded":"2024-01-19T05:01:39.970291+0000","last_fullsized":"2024-01-19T05:01:39.970291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'584","reported_seq":617,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:33.977903+0000","last_change":"2024-01-19T04:31:31.771293+0000","last_active":"2024-01-19T05:01:33.977903+0000","last_peered":"2024-01-19T05:01:33.977903+0000","last_clean":"2024-01-19T05:01:33.977903+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T05:01:33.977903+0000","last_undegraded":"2024-01-19T05:01:33.977903+0000","last_fullsized":"2024-01-19T05:01:33.977903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:30.402798+0000","last_clean_scrub_stamp":"2024-01-19T04:31:30.402798+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:19.578596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'23","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.697325+0000","last_change":"2024-01-19T04:31:33.039883+0000","last_active":"2024-01-19T05:01:41.697325+0000","last_peered":"2024-01-19T05:01:41.697325+0000","last_clean":"2024-01-19T05:01:41.697325+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T05:01:41.697325+0000","last_undegraded":"2024-01-19T05:01:41.697325+0000","last_fullsized":"2024-01-19T05:01:41.697325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:11.880294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:00:39.400511+0000","last_change":"2024-01-19T04:31:39.823318+0000","last_active":"2024-01-19T05:00:39.400511+0000","last_peered":"2024-01-19T05:00:39.400511+0000","last_clean":"2024-01-19T05:00:39.400511+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T05:00:39.400511+0000","last_undegraded":"2024-01-19T05:00:39.400511+0000","last_fullsized":"2024-01-19T05:00:39.400511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:38.427644+0000","last_clean_scrub_stamp":"2024-01-19T04:31:38.427644+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:18.770486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983016+0000","last_change":"2024-01-19T04:31:33.215698+0000","last_active":"2024-01-19T05:01:41.983016+0000","last_peered":"2024-01-19T05:01:41.983016+0000","last_clean":"2024-01-19T05:01:41.983016+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T05:01:41.983016+0000","last_undegraded":"2024-01-19T05:01:41.983016+0000","last_fullsized":"2024-01-19T05:01:41.983016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:01.790352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'30","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.998547+0000","last_change":"2024-01-19T04:31:34.775704+0000","last_active":"2024-01-19T05:01:41.998547+0000","last_peered":"2024-01-19T05:01:41.998547+0000","last_clean":"2024-01-19T05:01:41.998547+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T05:01:41.998547+0000","last_undegraded":"2024-01-19T05:01:41.998547+0000","last_fullsized":"2024-01-19T05:01:41.998547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'28","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.693715+0000","last_change":"2024-01-19T04:31:34.736189+0000","last_active":"2024-01-19T05:01:41.693715+0000","last_peered":"2024-01-19T05:01:41.693715+0000","last_clean":"2024-01-19T05:01:41.693715+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T05:01:41.693715+0000","last_undegraded":"2024-01-19T05:01:41.693715+0000","last_fullsized":"2024-01-19T05:01:41.693715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:07.781556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'24","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.897656+0000","last_change":"2024-01-19T04:31:33.153590+0000","last_active":"2024-01-19T05:01:41.897656+0000","last_peered":"2024-01-19T05:01:41.897656+0000","last_clean":"2024-01-19T05:01:41.897656+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T05:01:41.897656+0000","last_undegraded":"2024-01-19T05:01:41.897656+0000","last_fullsized":"2024-01-19T05:01:41.897656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'17","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.880027+0000","last_change":"2024-01-19T04:31:33.149682+0000","last_active":"2024-01-19T05:01:41.880027+0000","last_peered":"2024-01-19T05:01:41.880027+0000","last_clean":"2024-01-19T05:01:41.880027+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T05:01:41.880027+0000","last_undegraded":"2024-01-19T05:01:41.880027+0000","last_fullsized":"2024-01-19T05:01:41.880027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'22","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:53.721625+0000","last_change":"2024-01-19T04:31:34.847408+0000","last_active":"2024-01-19T05:01:53.721625+0000","last_peered":"2024-01-19T05:01:53.721625+0000","last_clean":"2024-01-19T05:01:53.721625+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T05:01:53.721625+0000","last_undegraded":"2024-01-19T05:01:53.721625+0000","last_fullsized":"2024-01-19T05:01:53.721625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'34","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.986000+0000","last_change":"2024-01-19T04:31:33.217481+0000","last_active":"2024-01-19T05:01:41.986000+0000","last_peered":"2024-01-19T05:01:41.986000+0000","last_clean":"2024-01-19T05:01:41.986000+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T05:01:41.986000+0000","last_undegraded":"2024-01-19T05:01:41.986000+0000","last_fullsized":"2024-01-19T05:01:41.986000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'18","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.873969+0000","last_change":"2024-01-19T04:31:33.151468+0000","last_active":"2024-01-19T05:01:41.873969+0000","last_peered":"2024-01-19T05:01:41.873969+0000","last_clean":"2024-01-19T05:01:41.873969+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T05:01:41.873969+0000","last_undegraded":"2024-01-19T05:01:41.873969+0000","last_fullsized":"2024-01-19T05:01:41.873969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'20","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.708579+0000","last_change":"2024-01-19T04:31:34.733234+0000","last_active":"2024-01-19T05:01:41.708579+0000","last_peered":"2024-01-19T05:01:41.708579+0000","last_clean":"2024-01-19T05:01:41.708579+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T05:01:41.708579+0000","last_undegraded":"2024-01-19T05:01:41.708579+0000","last_fullsized":"2024-01-19T05:01:41.708579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:37.400291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.879130+0000","last_change":"2024-01-19T04:31:33.148477+0000","last_active":"2024-01-19T05:01:41.879130+0000","last_peered":"2024-01-19T05:01:41.879130+0000","last_clean":"2024-01-19T05:01:41.879130+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T05:01:41.879130+0000","last_undegraded":"2024-01-19T05:01:41.879130+0000","last_fullsized":"2024-01-19T05:01:41.879130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:40:20.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'27","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.811706+0000","last_change":"2024-01-19T04:31:34.743690+0000","last_active":"2024-01-19T05:01:41.811706+0000","last_peered":"2024-01-19T05:01:41.811706+0000","last_clean":"2024-01-19T05:01:41.811706+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T05:01:41.811706+0000","last_undegraded":"2024-01-19T05:01:41.811706+0000","last_fullsized":"2024-01-19T05:01:41.811706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:12:03.811794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'31","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:55.942116+0000","last_change":"2024-01-19T05:01:55.942155+0000","last_active":"2024-01-19T05:01:55.942116+0000","last_peered":"2024-01-19T05:01:55.942116+0000","last_clean":"2024-01-19T05:01:55.942116+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T05:01:55.942116+0000","last_undegraded":"2024-01-19T05:01:55.942116+0000","last_fullsized":"2024-01-19T05:01:55.942116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-01-19T05:01:55.942018+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-01-19T05:01:55.942018+0000","last_clean_scrub_stamp":"2024-01-19T05:01:55.942018+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:38:26.247015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'25","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.983450+0000","last_change":"2024-01-19T04:31:33.220106+0000","last_active":"2024-01-19T05:01:41.983450+0000","last_peered":"2024-01-19T05:01:41.983450+0000","last_clean":"2024-01-19T05:01:41.983450+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T05:01:41.983450+0000","last_undegraded":"2024-01-19T05:01:41.983450+0000","last_fullsized":"2024-01-19T05:01:41.983450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:46.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.706377+0000","last_change":"2024-01-19T04:31:33.072880+0000","last_active":"2024-01-19T05:01:41.706377+0000","last_peered":"2024-01-19T05:01:41.706377+0000","last_clean":"2024-01-19T05:01:41.706377+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T05:01:41.706377+0000","last_undegraded":"2024-01-19T05:01:41.706377+0000","last_fullsized":"2024-01-19T05:01:41.706377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:16.755217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'31","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:54.567034+0000","last_change":"2024-01-19T04:31:35.306321+0000","last_active":"2024-01-19T05:01:54.567034+0000","last_peered":"2024-01-19T05:01:54.567034+0000","last_clean":"2024-01-19T05:01:54.567034+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T05:01:54.567034+0000","last_undegraded":"2024-01-19T05:01:54.567034+0000","last_fullsized":"2024-01-19T05:01:54.567034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'27","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.994289+0000","last_change":"2024-01-19T04:32:37.020144+0000","last_active":"2024-01-19T05:01:41.994289+0000","last_peered":"2024-01-19T05:01:41.994289+0000","last_clean":"2024-01-19T05:01:41.994289+0000","last_became_active":"2024-01-19T04:32:37.019820+0000","last_became_peered":"2024-01-19T04:32:37.019820+0000","last_unstale":"2024-01-19T05:01:41.994289+0000","last_undegraded":"2024-01-19T05:01:41.994289+0000","last_fullsized":"2024-01-19T05:01:41.994289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'30","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.818243+0000","last_change":"2024-01-19T04:31:35.043455+0000","last_active":"2024-01-19T05:01:41.818243+0000","last_peered":"2024-01-19T05:01:41.818243+0000","last_clean":"2024-01-19T05:01:41.818243+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T05:01:41.818243+0000","last_undegraded":"2024-01-19T05:01:41.818243+0000","last_fullsized":"2024-01-19T05:01:41.818243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'23","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:53.721679+0000","last_change":"2024-01-19T04:31:35.154479+0000","last_active":"2024-01-19T05:01:53.721679+0000","last_peered":"2024-01-19T05:01:53.721679+0000","last_clean":"2024-01-19T05:01:53.721679+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T05:01:53.721679+0000","last_undegraded":"2024-01-19T05:01:53.721679+0000","last_fullsized":"2024-01-19T05:01:53.721679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'25","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.895455+0000","last_change":"2024-01-19T04:31:33.034755+0000","last_active":"2024-01-19T05:01:41.895455+0000","last_peered":"2024-01-19T05:01:41.895455+0000","last_clean":"2024-01-19T05:01:41.895455+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T05:01:41.895455+0000","last_undegraded":"2024-01-19T05:01:41.895455+0000","last_fullsized":"2024-01-19T05:01:41.895455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'29","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.889958+0000","last_change":"2024-01-19T04:31:33.217575+0000","last_active":"2024-01-19T05:01:41.889958+0000","last_peered":"2024-01-19T05:01:41.889958+0000","last_clean":"2024-01-19T05:01:41.889958+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T05:01:41.889958+0000","last_undegraded":"2024-01-19T05:01:41.889958+0000","last_fullsized":"2024-01-19T05:01:41.889958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.171124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'18","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704394+0000","last_change":"2024-01-19T04:31:33.219498+0000","last_active":"2024-01-19T05:01:41.704394+0000","last_peered":"2024-01-19T05:01:41.704394+0000","last_clean":"2024-01-19T05:01:41.704394+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T05:01:41.704394+0000","last_undegraded":"2024-01-19T05:01:41.704394+0000","last_fullsized":"2024-01-19T05:01:41.704394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:46:31.294110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'24","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.980207+0000","last_change":"2024-01-19T04:31:33.252368+0000","last_active":"2024-01-19T05:01:41.980207+0000","last_peered":"2024-01-19T05:01:41.980207+0000","last_clean":"2024-01-19T05:01:41.980207+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T05:01:41.980207+0000","last_undegraded":"2024-01-19T05:01:41.980207+0000","last_fullsized":"2024-01-19T05:01:41.980207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:40.382305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.986160+0000","last_change":"2024-01-19T04:31:33.248788+0000","last_active":"2024-01-19T05:01:41.986160+0000","last_peered":"2024-01-19T05:01:41.986160+0000","last_clean":"2024-01-19T05:01:41.986160+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T05:01:41.986160+0000","last_undegraded":"2024-01-19T05:01:41.986160+0000","last_fullsized":"2024-01-19T05:01:41.986160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:10:03.356611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.815246+0000","last_change":"2024-01-19T04:31:33.253803+0000","last_active":"2024-01-19T05:01:41.815246+0000","last_peered":"2024-01-19T05:01:41.815246+0000","last_clean":"2024-01-19T05:01:41.815246+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T05:01:41.815246+0000","last_undegraded":"2024-01-19T05:01:41.815246+0000","last_fullsized":"2024-01-19T05:01:41.815246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:16.888316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'19","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.892314+0000","last_change":"2024-01-19T04:31:33.249616+0000","last_active":"2024-01-19T05:01:41.892314+0000","last_peered":"2024-01-19T05:01:41.892314+0000","last_clean":"2024-01-19T05:01:41.892314+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T05:01:41.892314+0000","last_undegraded":"2024-01-19T05:01:41.892314+0000","last_fullsized":"2024-01-19T05:01:41.892314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:54:43.396015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'21","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.679032+0000","last_change":"2024-01-19T04:31:32.992386+0000","last_active":"2024-01-19T05:01:41.679032+0000","last_peered":"2024-01-19T05:01:41.679032+0000","last_clean":"2024-01-19T05:01:41.679032+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T05:01:41.679032+0000","last_undegraded":"2024-01-19T05:01:41.679032+0000","last_fullsized":"2024-01-19T05:01:41.679032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:59:27.224007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'28","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.746534+0000","last_change":"2024-01-19T04:31:35.043167+0000","last_active":"2024-01-19T05:01:41.746534+0000","last_peered":"2024-01-19T05:01:41.746534+0000","last_clean":"2024-01-19T05:01:41.746534+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T05:01:41.746534+0000","last_undegraded":"2024-01-19T05:01:41.746534+0000","last_fullsized":"2024-01-19T05:01:41.746534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:13:20.601585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'24","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.668813+0000","last_change":"2024-01-19T04:32:36.986632+0000","last_active":"2024-01-19T05:01:41.668813+0000","last_peered":"2024-01-19T05:01:41.668813+0000","last_clean":"2024-01-19T05:01:41.668813+0000","last_became_active":"2024-01-19T04:32:36.986250+0000","last_became_peered":"2024-01-19T04:32:36.986250+0000","last_unstale":"2024-01-19T05:01:41.668813+0000","last_undegraded":"2024-01-19T05:01:41.668813+0000","last_fullsized":"2024-01-19T05:01:41.668813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"31'18","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.817181+0000","last_change":"2024-01-19T04:31:34.733342+0000","last_active":"2024-01-19T05:01:41.817181+0000","last_peered":"2024-01-19T05:01:41.817181+0000","last_clean":"2024-01-19T05:01:41.817181+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T05:01:41.817181+0000","last_undegraded":"2024-01-19T05:01:41.817181+0000","last_fullsized":"2024-01-19T05:01:41.817181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:09:28.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'26","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:52.899853+0000","last_change":"2024-01-19T05:01:52.899911+0000","last_active":"2024-01-19T05:01:52.899853+0000","last_peered":"2024-01-19T05:01:52.899853+0000","last_clean":"2024-01-19T05:01:52.899853+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T05:01:52.899853+0000","last_undegraded":"2024-01-19T05:01:52.899853+0000","last_fullsized":"2024-01-19T05:01:52.899853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2024-01-19T05:01:52.899695+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2024-01-19T05:01:52.899695+0000","last_clean_scrub_stamp":"2024-01-19T05:01:52.899695+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:38.851011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'19","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.661735+0000","last_change":"2024-01-19T04:31:35.043212+0000","last_active":"2024-01-19T05:01:41.661735+0000","last_peered":"2024-01-19T05:01:41.661735+0000","last_clean":"2024-01-19T05:01:41.661735+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T05:01:41.661735+0000","last_undegraded":"2024-01-19T05:01:41.661735+0000","last_fullsized":"2024-01-19T05:01:41.661735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'24","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:41.704922+0000","last_change":"2024-01-19T04:31:33.216818+0000","last_active":"2024-01-19T05:01:41.704922+0000","last_peered":"2024-01-19T05:01:41.704922+0000","last_clean":"2024-01-19T05:01:41.704922+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T05:01:41.704922+0000","last_undegraded":"2024-01-19T05:01:41.704922+0000","last_fullsized":"2024-01-19T05:01:41.704922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:31:31.485642+0000","last_clean_scrub_stamp":"2024-01-19T04:31:31.485642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:14:27.414150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2422,"num_write_kb":254160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2601,"ondisk_log_size":2601,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1580,"ondisk_log_size":1580,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24103801,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":5649,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48455680,"data_stored":48207602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5180,"ondisk_log_size":5180,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477114,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":495616,"data_stored":270316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.26100000000000001},"max":{"1min":1.2509999999999999,"5min":1.3160000000000001,"15min":2.2389999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.76200000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.29699999999999999},"max":{"1min":1.4099999999999999,"5min":1.4339999999999999,"15min":1.6739999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.309},"max":{"1min":1.264,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.875,"15min":0.81899999999999995},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.32200000000000001},"max":{"1min":1.202,"5min":1.754,"15min":1.754},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.77300000000000002},"min":{"1min":0.45400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2709999999999999,"5min":2.52,"15min":2.52},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93799999999999994,"15min":0.90500000000000003},"min":{"1min":0.437,"5min":0.373,"15min":0.31900000000000001},"max":{"1min":1.321,"5min":1.5,"15min":2.0670000000000002},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0740000000000001,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":1.667,"15min":1.9590000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0820000000000001,"15min":1.0509999999999999},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.49,"5min":1.867,"15min":1.867},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1040000000000001,"15min":1.081},"min":{"1min":0.73399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.452,"5min":1.954,"15min":1.954},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":2.625,"15min":2.625},"last":0.87}]},{"osd":6,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.0880000000000001,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.085},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1599999999999999,"15min":1.1439999999999999},"min":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.57799999999999996},"max":{"1min":1.736,"5min":1.736,"15min":2.129},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.151},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":1.913,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1890000000000001,"15min":1.119},"min":{"1min":0.84899999999999998,"5min":0.74399999999999999,"15min":0.60499999999999998},"max":{"1min":1.444,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.002}]}]},{"osd":1,"up_from":16,"seq":68719477115,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":140672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.4490000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.675},"last":1.0289999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.29399999999999998},"max":{"1min":1.22,"5min":1.244,"15min":1.4930000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.86199999999999999,"15min":0.84499999999999997},"min":{"1min":0.59299999999999997,"5min":0.40000000000000002,"15min":0.29499999999999998},"max":{"1min":1.466,"5min":1.468,"15min":1.486},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.68400000000000005,"5min":0.443,"15min":0.31900000000000001},"max":{"1min":1.1639999999999999,"5min":1.3140000000000001,"15min":1.6200000000000001},"last":0.873},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.875,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.605,"15min":1.605},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.65700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3400000000000001,"5min":1.47,"15min":1.7689999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1160000000000001,"15min":1.1020000000000001},"min":{"1min":0.81200000000000006,"5min":0.69399999999999995,"15min":0.63300000000000001},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.9590000000000001},"last":0.996}]},{"osd":5,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0920000000000001},"min":{"1min":0.871,"5min":0.63300000000000001,"15min":0.60399999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.83699999999999997,"5min":0.56299999999999994,"15min":0.45500000000000002},"max":{"1min":1.5329999999999999,"5min":1.5469999999999999,"15min":1.72},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.242},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.133,"15min":1.1359999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0030000000000001},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.1850000000000001},"min":{"1min":0.94999999999999996,"5min":0.76700000000000002,"15min":0.61299999999999999},"max":{"1min":1.744,"5min":1.9139999999999999,"15min":2.0150000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.89200000000000002,"5min":0.73599999999999999,"15min":0.69099999999999995},"max":{"1min":1.921,"5min":1.921,"15min":2.2650000000000001},"last":1.3420000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509818,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":8744960,"data_stored":8529791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.84299999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.2909999999999999,"15min":1.3500000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86699999999999999,"15min":0.877},"min":{"1min":0.57599999999999996,"5min":0.53100000000000003,"15min":0.42699999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.712},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.216,"5min":1.4359999999999999,"15min":1.5269999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94099999999999995,"15min":0.92400000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.45200000000000001},"max":{"1min":1.2569999999999999,"5min":1.391,"15min":1.3999999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92500000000000004,"15min":0.91000000000000003},"min":{"1min":0.67900000000000005,"5min":0.60499999999999998,"15min":0.46700000000000003},"max":{"1min":1.4139999999999999,"5min":1.462,"15min":1.5740000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.022,"15min":0.96999999999999997},"min":{"1min":0.76200000000000001,"5min":0.66800000000000004,"15min":0.55600000000000005},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.627}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97199999999999998,"15min":0.95299999999999996},"min":{"1min":0.69899999999999995,"5min":0.625,"15min":0.46100000000000002},"max":{"1min":1.3640000000000001,"5min":1.3979999999999999,"15min":1.4850000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.079,"15min":1.0469999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.47899999999999998},"max":{"1min":1.3979999999999999,"5min":1.552,"15min":1.6180000000000001},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94399999999999995},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.58899999999999997},"max":{"1min":1.167,"5min":1.3360000000000001,"15min":1.8169999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0760000000000001,"15min":1.0740000000000001},"min":{"1min":0.84199999999999997,"5min":0.59799999999999998,"15min":0.46800000000000003},"max":{"1min":1.4319999999999999,"5min":1.486,"15min":1.7589999999999999},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0189999999999999,"15min":1.0129999999999999},"min":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.45700000000000002},"max":{"1min":1.3540000000000001,"5min":1.444,"15min":1.657},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.119,"15min":1.135},"min":{"1min":0.73799999999999999,"5min":0.66100000000000003,"15min":0.61699999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.698},"last":1.242}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.155},"min":{"1min":0.89300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1499999999999999,"15min":1.143},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3360000000000001,"5min":1.512,"15min":1.7769999999999999},"last":1.087}]}]},{"osd":5,"up_from":15,"seq":64424509818,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":143653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.84799999999999998,"15min":0.81499999999999995},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.433},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95699999999999996,"15min":0.92400000000000004},"min":{"1min":0.63600000000000001,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.91200000000000003},"min":{"1min":0.69699999999999995,"5min":0.55300000000000005,"15min":0.40300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":0.98699999999999999},"min":{"1min":0.61699999999999999,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.97199999999999998,"15min":0.94499999999999995},"min":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.51100000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.871}]},{"osd":3,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.0600000000000001},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.47399999999999998},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0669999999999999,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.58899999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.95699999999999996}]},{"osd":4,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.90800000000000003,"15min":0.89400000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47899999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.65000000000000002,"15min":0.51900000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.089}]},{"osd":6,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.028,"15min":1.0449999999999999},"min":{"1min":0.68600000000000005,"5min":0.58299999999999996,"15min":0.44900000000000001},"max":{"1min":1.3839999999999999,"5min":1.466,"15min":1.468},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.008,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.33200000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.0389999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1839999999999999,"15min":1.171},"min":{"1min":1.016,"5min":0.79700000000000004,"15min":0.42399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.64500000000000002,"15min":0.57999999999999996},"max":{"1min":1.5389999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.169}]}]},{"osd":4,"up_from":15,"seq":64424509817,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":8744960,"data_stored":8529659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88100000000000001,"15min":0.88500000000000001},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1990000000000001,"5min":1.3109999999999999,"15min":2.04},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.0149999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3089999999999999,"5min":1.4399999999999999,"15min":2.1970000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.51500000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.6309999999999998},"last":1.1519999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.51300000000000001},"max":{"1min":1.3879999999999999,"5min":1.6279999999999999,"15min":2.7810000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64000000000000001,"5min":0.55100000000000005,"15min":0.504},"max":{"1min":1.5640000000000001,"5min":1.7,"15min":1.7},"last":1.1259999999999999}]},{"osd":3,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.008,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":2.4820000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.123,"5min":1.069,"15min":1.083},"min":{"1min":0.84399999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.339,"5min":1.5369999999999999,"15min":2.4399999999999999},"last":0.97499999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.46000000000000002},"max":{"1min":1.484,"5min":1.5149999999999999,"15min":1.9119999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.034,"15min":1.054},"min":{"1min":0.70799999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":2.7160000000000002},"last":1.089}]},{"osd":6,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.115,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.474,"5min":1.502,"15min":2.3650000000000002},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.095,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7549999999999999},"last":1.296}]},{"osd":7,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1080000000000001,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.601,"5min":1.601,"15min":3.1720000000000002},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.49,"5min":1.718,"15min":2.8999999999999999},"last":1.1839999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509818,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":11600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":11878400,"data_stored":11653269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.33600000000000002},"max":{"1min":1.0009999999999999,"5min":1.47,"15min":1.47},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.71699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.30599999999999999},"max":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.3109999999999999},"last":0.375}]},{"osd":1,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.33400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3069999999999999,"15min":1.4339999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85199999999999998,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.42499999999999999,"15min":0.36199999999999999},"max":{"1min":1.153,"5min":1.444,"15min":1.444},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.47599999999999998,"15min":0.376},"max":{"1min":1.397,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.88500000000000001},"min":{"1min":0.51300000000000001,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4870000000000001,"5min":1.5369999999999999,"15min":1.5680000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.5049999999999999,"15min":1.5580000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.103,"15min":1.075},"min":{"1min":0.78100000000000003,"5min":0.65100000000000002,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.0349999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.0920000000000001},"min":{"1min":0.68700000000000006,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.728,"15min":1.728},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.0580000000000001},"min":{"1min":0.74399999999999999,"5min":0.621,"15min":0.60299999999999998},"max":{"1min":1.6459999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0940000000000001,"15min":1.0649999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.56200000000000006},"max":{"1min":1.3939999999999999,"5min":1.569,"15min":1.734},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.165},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1180000000000001},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.60999999999999999},"max":{"1min":1.5700000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.163,"15min":1.1240000000000001},"min":{"1min":0.93200000000000005,"5min":0.78300000000000003,"15min":0.69999999999999996},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.8340000000000001},"last":1.1339999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542522,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48564,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323276,"statfs":{"total":96636764160,"available":96587034624,"internally_reserved":0,"allocated":13545472,"data_stored":13315101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.495,"15min":0.372},"max":{"1min":1.212,"5min":1.577,"15min":1.577},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94899999999999995,"15min":0.93100000000000005},"min":{"1min":0.65500000000000003,"5min":0.51100000000000001,"15min":0.47699999999999998},"max":{"1min":1.2150000000000001,"5min":1.294,"15min":1.4430000000000001},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.65300000000000002,"5min":0.55900000000000005,"15min":0.48899999999999999},"max":{"1min":1.22,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.02,"5min":0.94499999999999995,"15min":0.92000000000000004},"min":{"1min":0.73499999999999999,"5min":0.55100000000000005,"15min":0.48399999999999999},"max":{"1min":1.2889999999999999,"5min":1.3560000000000001,"15min":1.7549999999999999},"last":1.2010000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94799999999999995,"15min":0.96099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.5349999999999999,"15min":1.5509999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0069999999999999,"15min":0.999},"min":{"1min":0.67900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.325,"5min":1.4390000000000001,"15min":1.6319999999999999},"last":0.84999999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.04,"15min":1.0169999999999999},"min":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3240000000000001,"5min":1.5009999999999999,"15min":1.542},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.70899999999999996,"5min":0.51100000000000001,"15min":0.46500000000000002},"max":{"1min":1.1679999999999999,"5min":1.758,"15min":1.758},"last":0.998}]},{"osd":4,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40799999999999997},"max":{"1min":1.395,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.175},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0249999999999999,"15min":1.0549999999999999},"min":{"1min":0.70799999999999996,"5min":0.53500000000000003,"15min":0.40600000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6339999999999999},"last":1.3320000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0580000000000001,"15min":1.0549999999999999},"min":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.622},"max":{"1min":1.367,"5min":1.51,"15min":1.9259999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.087,"15min":1.093},"min":{"1min":0.626,"5min":0.61099999999999999,"15min":0.432},"max":{"1min":1.298,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.236}]},{"osd":6,"last update":"Fri Jan 19 05:01:00 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.1359999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.45600000000000002},"max":{"1min":1.4550000000000001,"5min":1.4710000000000001,"15min":1.8480000000000001},"last":1.522},{"interface":"front","average":{"1min":1.149,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.67600000000000005},"max":{"1min":1.4219999999999999,"5min":1.5680000000000001,"15min":1.75},"last":1.2749999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542522,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34972,"kb_used_data":7956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336868,"statfs":{"total":96636764160,"available":96600952832,"internally_reserved":0,"allocated":8146944,"data_stored":7918997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.373,"15min":0.29099999999999998},"max":{"1min":1.224,"5min":1.224,"15min":2.1629999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.33000000000000002},"max":{"1min":1.0740000000000001,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.503}]},{"osd":2,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":0.77100000000000002},"min":{"1min":0.53600000000000003,"5min":0.36399999999999999,"15min":0.317},"max":{"1min":0.88100000000000001,"5min":1.861,"15min":1.861},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.62,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":1.25,"5min":1.4770000000000001,"15min":2.2490000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.87,"15min":0.82299999999999995},"min":{"1min":0.58599999999999997,"5min":0.41899999999999998,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93700000000000006,"15min":0.88400000000000001},"min":{"1min":0.69299999999999995,"5min":0.42199999999999999,"15min":0.32600000000000001},"max":{"1min":1.2729999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1},"min":{"1min":0.83999999999999997,"5min":0.56299999999999994,"15min":0.502},"max":{"1min":1.286,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.0620000000000001,"15min":1.0529999999999999},"min":{"1min":0.73599999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4299999999999999,"5min":2.0750000000000002,"15min":2.3330000000000002},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.56499999999999995,"15min":0.46800000000000003},"max":{"1min":1.4039999999999999,"5min":1.909,"15min":1.909},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3939999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1539999999999999,"15min":1.125},"min":{"1min":0.96999999999999997,"5min":0.73999999999999999,"15min":0.61299999999999999},"max":{"1min":1.5189999999999999,"5min":1.998,"15min":2.4500000000000002},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.163,"15min":1.149},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.831,"15min":1.964},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.206,"15min":1.181},"min":{"1min":0.96799999999999997,"5min":0.76500000000000001,"15min":0.61399999999999999},"max":{"1min":1.5009999999999999,"5min":1.968,"15min":1.968},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.2569999999999999,"15min":1.1850000000000001},"min":{"1min":0.86199999999999999,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.502,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":7189489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":131176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11546624,"data_stored":11514129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:02:00.327 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.328 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.329 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.330 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.331 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-19T04:30:46.763072+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=30, tm_sec=46, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.332 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.333 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.334 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.335 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.336 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-01-19T04:31:30.402798+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=30, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-19T04:31:38.427644+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=38, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.337 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.338 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.339 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.340 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.340 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.340 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-01-19T04:31:31.485642+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=31, tm_sec=31, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=1, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:02:00.340 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-19T05:02:16.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:02:16.158 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:02:20.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:02:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 Processor -- start 2024-01-19T05:02:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 -- start start 2024-01-19T05:02:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa28015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa28006ea20 0x7fa28006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28015a6c0 con 0x7fa2800c0e90 2024-01-19T05:02:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800c2de0 con 0x7fa28006ea20 2024-01-19T05:02:20.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa286b2e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800c6e20 con 0x7fa280156c70 2024-01-19T05:02:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa277fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa28006ea20 0x7fa28006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:20.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa2848ca640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa28015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:20.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa277fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa28006ea20 0x7fa28006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:42968/0 (socket says 172.21.15.133:42968) 2024-01-19T05:02:20.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.477+0000 7fa277fff640 1 -- 172.21.15.133:0/1266555490 learned_addr learned my addr 172.21.15.133:0/1266555490 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:20.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.485+0000 7fa2848ca640 1 -- 172.21.15.133:0/1266555490 >> v2:172.21.15.156:3300/0 conn(0x7fa28006ea20 msgr2=0x7fa28006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:20.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.485+0000 7fa2848ca640 1 --2- 172.21.15.133:0/1266555490 >> v2:172.21.15.156:3300/0 conn(0x7fa28006ea20 0x7fa28006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:20.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.485+0000 7fa2848ca640 1 -- 172.21.15.133:0/1266555490 >> v1:172.21.15.156:6789/0 conn(0x7fa2800c0e90 legacy=0x7fa2800c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:20.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.485+0000 7fa2848ca640 1 -- 172.21.15.133:0/1266555490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28006e590 con 0x7fa280156c70 2024-01-19T05:02:20.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.489+0000 7fa2848ca640 1 --2- 172.21.15.133:0/1266555490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa28015a180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0097c0 tx=0x7fa27c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=573a9da5b59ee40f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:20.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa2777fe640 1 -- 172.21.15.133:0/1266555490 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0ab600 con 0x7fa280156c70 2024-01-19T05:02:20.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa2777fe640 1 -- 172.21.15.133:0/1266555490 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c0a7050 con 0x7fa280156c70 2024-01-19T05:02:20.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa2777fe640 1 -- 172.21.15.133:0/1266555490 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0ab980 con 0x7fa280156c70 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 -- 172.21.15.133:0/1266555490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 msgr2=0x7fa28015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 --2- 172.21.15.133:0/1266555490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa28015a180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0097c0 tx=0x7fa27c01c440 comp rx=0 tx=0).stop 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 -- 172.21.15.133:0/1266555490 shutdown_connections 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 --2- 172.21.15.133:0/1266555490 >> v2:172.21.15.156:3300/0 conn(0x7fa28006ea20 0x7fa28006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 --2- 172.21.15.133:0/1266555490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa28015a180 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 -- 172.21.15.133:0/1266555490 >> 172.21.15.133:0/1266555490 conn(0x7fa280072450 msgr2=0x7fa28006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:20.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 -- 172.21.15.133:0/1266555490 shutdown_connections 2024-01-19T05:02:20.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.501+0000 7fa286b2e640 1 -- 172.21.15.133:0/1266555490 wait complete. 2024-01-19T05:02:20.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 Processor -- start 2024-01-19T05:02:20.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 -- start start 2024-01-19T05:02:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa28006ea20 0x7fa28014a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 0x7fa280152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa280143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28014a220 con 0x7fa2800c0e90 2024-01-19T05:02:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa280151460 con 0x7fa28006ea20 2024-01-19T05:02:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa286b2e640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280150ea0 con 0x7fa280156c70 2024-01-19T05:02:20.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa277fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 0x7fa280152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:20.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa277fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 0x7fa280152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43124/0 (socket says 172.21.15.133:43124) 2024-01-19T05:02:20.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa277fff640 1 -- 172.21.15.133:0/4247239475 learned_addr learned my addr 172.21.15.133:0/4247239475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:20.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.505+0000 7fa2848ca640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa28006ea20 0x7fa28014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.509+0000 7fa2850cb640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa280143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.509+0000 7fa277fff640 1 -- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 msgr2=0x7fa280143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.509+0000 7fa277fff640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa280143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.509+0000 7fa277fff640 1 -- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa28006ea20 msgr2=0x7fa28014a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.509+0000 7fa277fff640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa28006ea20 0x7fa28014a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.509+0000 7fa277fff640 1 -- 172.21.15.133:0/4247239475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c009420 con 0x7fa2800c0e90 2024-01-19T05:02:20.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.513+0000 7fa277fff640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 0x7fa280152c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e820 tx=0x7fa27000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.513+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000c940 con 0x7fa2800c0e90 2024-01-19T05:02:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.517+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2801571d0 con 0x7fa2800c0e90 2024-01-19T05:02:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.517+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa280149b60 con 0x7fa2800c0e90 2024-01-19T05:02:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.517+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280074340 con 0x7fa2800c0e90 2024-01-19T05:02:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.517+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000caa0 con 0x7fa2800c0e90 2024-01-19T05:02:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.517+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000ce10 con 0x7fa2800c0e90 2024-01-19T05:02:20.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.793+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa2700059a0 con 0x7fa2800c0e90 2024-01-19T05:02:20.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.793+0000 7fa2757fa640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa26c066500 0x7fa26c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.793+0000 7fa2848ca640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa26c066500 0x7fa26c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.793+0000 7fa2848ca640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa26c066500 0x7fa26c0689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0ad000 tx=0x7fa27c0a6000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:20.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.829+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa270055d20 con 0x7fa2800c0e90 2024-01-19T05:02:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:20.829+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa270051960 con 0x7fa2800c0e90 2024-01-19T05:02:21.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.041+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 --> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2800c1400 con 0x7fa26c066500 2024-01-19T05:02:21.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.069+0000 7fa2757fa640 1 -- 172.21.15.133:0/4247239475 <== mgr.4113 v2:172.21.15.156:6800/2555181525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369833 (secure 0 0 0) 0x7fa2800c1400 con 0x7fa26c066500 2024-01-19T05:02:21.073 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:02:21.075 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa26c066500 msgr2=0x7fa26c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa26c066500 0x7fa26c0689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0ad000 tx=0x7fa27c0a6000 comp rx=0 tx=0).stop 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 msgr2=0x7fa280152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 0x7fa280152c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e820 tx=0x7fa27000ece0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 shutdown_connections 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fa26c066500 0x7fa26c0689c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa280156c70 0x7fa280143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2800c0e90 0x7fa280152c30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 --2- 172.21.15.133:0/4247239475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa28006ea20 0x7fa28014a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 >> 172.21.15.133:0/4247239475 conn(0x7fa280072450 msgr2=0x7fa28006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 shutdown_connections 2024-01-19T05:02:21.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.073+0000 7fa286b2e640 1 -- 172.21.15.133:0/4247239475 wait complete. 2024-01-19T05:02:21.092 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":974,"stamp":"2024-01-19T05:02:20.428742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24694169,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":677,"num_read_kb":685,"num_write":8230,"num_write_kb":283324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9559,"ondisk_log_size":9559,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":331008,"kb_used_data":51072,"kb_used_omap":12,"kb_used_meta":279859,"kb_avail":754643712,"statfs":{"total":773094113280,"available":772755161088,"internally_reserved":0,"allocated":52297728,"data_stored":50501458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":286576176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005118"},"pg_stats":[{"pgid":"2.1f","version":"31'652","reported_seq":696,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:53.926864+0000","last_change":"2024-01-19T05:01:53.926930+0000","last_active":"2024-01-19T05:01:53.926864+0000","last_peered":"2024-01-19T05:01:53.926864+0000","last_clean":"2024-01-19T05:01:53.926864+0000","last_became_active":"2024-01-19T04:31:31.776185+0000","last_became_peered":"2024-01-19T04:31:31.776185+0000","last_unstale":"2024-01-19T05:01:53.926864+0000","last_undegraded":"2024-01-19T05:01:53.926864+0000","last_fullsized":"2024-01-19T05:01:53.926864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'652","last_scrub_stamp":"2024-01-19T05:01:53.926791+0000","last_deep_scrub":"31'652","last_deep_scrub_stamp":"2024-01-19T05:01:53.926791+0000","last_clean_scrub_stamp":"2024-01-19T05:01:53.926791+0000","objects_scrubbed":7,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:18:31.638829+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'16","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:55.821152+0000","last_change":"2024-01-19T05:01:55.821273+0000","last_active":"2024-01-19T05:01:55.821152+0000","last_peered":"2024-01-19T05:01:55.821152+0000","last_clean":"2024-01-19T05:01:55.821152+0000","last_became_active":"2024-01-19T04:31:33.216351+0000","last_became_peered":"2024-01-19T04:31:33.216351+0000","last_unstale":"2024-01-19T05:01:55.821152+0000","last_undegraded":"2024-01-19T05:01:55.821152+0000","last_fullsized":"2024-01-19T05:01:55.821152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-01-19T05:01:55.820977+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-01-19T05:01:55.820977+0000","last_clean_scrub_stamp":"2024-01-19T05:01:55.820977+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:55:58.430893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'82","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:11.855325+0000","last_change":"2024-01-19T05:02:11.855391+0000","last_active":"2024-01-19T05:02:11.855325+0000","last_peered":"2024-01-19T05:02:11.855325+0000","last_clean":"2024-01-19T05:02:11.855325+0000","last_became_active":"2024-01-19T04:31:39.818185+0000","last_became_peered":"2024-01-19T04:31:39.818185+0000","last_unstale":"2024-01-19T05:02:11.855325+0000","last_undegraded":"2024-01-19T05:02:11.855325+0000","last_fullsized":"2024-01-19T05:02:11.855325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'82","last_scrub_stamp":"2024-01-19T05:02:11.855152+0000","last_deep_scrub":"31'82","last_deep_scrub_stamp":"2024-01-19T05:02:11.855152+0000","last_clean_scrub_stamp":"2024-01-19T05:02:11.855152+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:43:30.539628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'262","reported_seq":307,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.870846+0000","last_change":"2024-01-19T05:02:01.870937+0000","last_active":"2024-01-19T05:02:01.870846+0000","last_peered":"2024-01-19T05:02:01.870846+0000","last_clean":"2024-01-19T05:02:01.870846+0000","last_became_active":"2024-01-19T04:31:31.775818+0000","last_became_peered":"2024-01-19T04:31:31.775818+0000","last_unstale":"2024-01-19T05:02:01.870846+0000","last_undegraded":"2024-01-19T05:02:01.870846+0000","last_fullsized":"2024-01-19T05:02:01.870846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'262","last_scrub_stamp":"2024-01-19T05:02:01.870680+0000","last_deep_scrub":"31'262","last_deep_scrub_stamp":"2024-01-19T05:02:01.870680+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.870680+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:01:38.590543+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2994311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'23","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.857008+0000","last_change":"2024-01-19T05:02:03.857119+0000","last_active":"2024-01-19T05:02:03.857008+0000","last_peered":"2024-01-19T05:02:03.857008+0000","last_clean":"2024-01-19T05:02:03.857008+0000","last_became_active":"2024-01-19T04:31:33.252413+0000","last_became_peered":"2024-01-19T04:31:33.252413+0000","last_unstale":"2024-01-19T05:02:03.857008+0000","last_undegraded":"2024-01-19T05:02:03.857008+0000","last_fullsized":"2024-01-19T05:02:03.857008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:03.856766+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:03.856766+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.856766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:08.664354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'79","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.294120+0000","last_change":"2024-01-19T05:02:07.294181+0000","last_active":"2024-01-19T05:02:07.294120+0000","last_peered":"2024-01-19T05:02:07.294120+0000","last_clean":"2024-01-19T05:02:07.294120+0000","last_became_active":"2024-01-19T04:31:39.829208+0000","last_became_peered":"2024-01-19T04:31:39.829208+0000","last_unstale":"2024-01-19T05:02:07.294120+0000","last_undegraded":"2024-01-19T05:02:07.294120+0000","last_fullsized":"2024-01-19T05:02:07.294120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'79","last_scrub_stamp":"2024-01-19T05:02:07.293957+0000","last_deep_scrub":"31'79","last_deep_scrub_stamp":"2024-01-19T05:02:07.293957+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.293957+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:47:21.909504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'23","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.770670+0000","last_change":"2024-01-19T05:02:06.770744+0000","last_active":"2024-01-19T05:02:06.770670+0000","last_peered":"2024-01-19T05:02:06.770670+0000","last_clean":"2024-01-19T05:02:06.770670+0000","last_became_active":"2024-01-19T04:31:31.830531+0000","last_became_peered":"2024-01-19T04:31:31.830531+0000","last_unstale":"2024-01-19T05:02:06.770670+0000","last_undegraded":"2024-01-19T05:02:06.770670+0000","last_fullsized":"2024-01-19T05:02:06.770670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:06.770501+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:06.770501+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.770501+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:54:44.974260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'21","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:09.392012+0000","last_change":"2024-01-19T05:02:09.392131+0000","last_active":"2024-01-19T05:02:09.392012+0000","last_peered":"2024-01-19T05:02:09.392012+0000","last_clean":"2024-01-19T05:02:09.392012+0000","last_became_active":"2024-01-19T04:31:35.152807+0000","last_became_peered":"2024-01-19T04:31:35.152807+0000","last_unstale":"2024-01-19T05:02:09.392012+0000","last_undegraded":"2024-01-19T05:02:09.392012+0000","last_fullsized":"2024-01-19T05:02:09.392012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-01-19T05:02:09.391809+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-01-19T05:02:09.391809+0000","last_clean_scrub_stamp":"2024-01-19T05:02:09.391809+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:47.083745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'86","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.287296+0000","last_change":"2024-01-19T05:02:06.287419+0000","last_active":"2024-01-19T05:02:06.287296+0000","last_peered":"2024-01-19T05:02:06.287296+0000","last_clean":"2024-01-19T05:02:06.287296+0000","last_became_active":"2024-01-19T04:31:39.824436+0000","last_became_peered":"2024-01-19T04:31:39.824436+0000","last_unstale":"2024-01-19T05:02:06.287296+0000","last_undegraded":"2024-01-19T05:02:06.287296+0000","last_fullsized":"2024-01-19T05:02:06.287296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'86","last_scrub_stamp":"2024-01-19T05:02:06.287035+0000","last_deep_scrub":"31'86","last_deep_scrub_stamp":"2024-01-19T05:02:06.287035+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.287035+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:54.452363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.871274+0000","last_change":"2024-01-19T05:02:03.871344+0000","last_active":"2024-01-19T05:02:03.871274+0000","last_peered":"2024-01-19T05:02:03.871274+0000","last_clean":"2024-01-19T05:02:03.871274+0000","last_became_active":"2024-01-19T04:31:31.797886+0000","last_became_peered":"2024-01-19T04:31:31.797886+0000","last_unstale":"2024-01-19T05:02:03.871274+0000","last_undegraded":"2024-01-19T05:02:03.871274+0000","last_fullsized":"2024-01-19T05:02:03.871274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-01-19T05:02:03.871102+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-01-19T05:02:03.871102+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.871102+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:48:28.606654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:10.381772+0000","last_change":"2024-01-19T05:02:10.381832+0000","last_active":"2024-01-19T05:02:10.381772+0000","last_peered":"2024-01-19T05:02:10.381772+0000","last_clean":"2024-01-19T05:02:10.381772+0000","last_became_active":"2024-01-19T04:31:35.153137+0000","last_became_peered":"2024-01-19T04:31:35.153137+0000","last_unstale":"2024-01-19T05:02:10.381772+0000","last_undegraded":"2024-01-19T05:02:10.381772+0000","last_fullsized":"2024-01-19T05:02:10.381772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-01-19T05:02:10.381611+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-01-19T05:02:10.381611+0000","last_clean_scrub_stamp":"2024-01-19T05:02:10.381611+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:50:50.683463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'85","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.266742+0000","last_change":"2024-01-19T05:02:04.266806+0000","last_active":"2024-01-19T05:02:04.266742+0000","last_peered":"2024-01-19T05:02:04.266742+0000","last_clean":"2024-01-19T05:02:04.266742+0000","last_became_active":"2024-01-19T04:31:39.821830+0000","last_became_peered":"2024-01-19T04:31:39.821830+0000","last_unstale":"2024-01-19T05:02:04.266742+0000","last_undegraded":"2024-01-19T05:02:04.266742+0000","last_fullsized":"2024-01-19T05:02:04.266742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'85","last_scrub_stamp":"2024-01-19T05:02:04.266551+0000","last_deep_scrub":"31'85","last_deep_scrub_stamp":"2024-01-19T05:02:04.266551+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.266551+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:03:51.707796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":9173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'18","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.690265+0000","last_change":"2024-01-19T05:02:06.690415+0000","last_active":"2024-01-19T05:02:06.690265+0000","last_peered":"2024-01-19T05:02:06.690265+0000","last_clean":"2024-01-19T05:02:06.690265+0000","last_became_active":"2024-01-19T04:31:33.219566+0000","last_became_peered":"2024-01-19T04:31:33.219566+0000","last_unstale":"2024-01-19T05:02:06.690265+0000","last_undegraded":"2024-01-19T05:02:06.690265+0000","last_fullsized":"2024-01-19T05:02:06.690265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:02:06.689989+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:02:06.689989+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.689989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:09:18.229372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'679","reported_seq":723,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.799192+0000","last_change":"2024-01-19T05:02:05.799265+0000","last_active":"2024-01-19T05:02:05.799192+0000","last_peered":"2024-01-19T05:02:05.799192+0000","last_clean":"2024-01-19T05:02:05.799192+0000","last_became_active":"2024-01-19T04:31:31.805787+0000","last_became_peered":"2024-01-19T04:31:31.805787+0000","last_unstale":"2024-01-19T05:02:05.799192+0000","last_undegraded":"2024-01-19T05:02:05.799192+0000","last_fullsized":"2024-01-19T05:02:05.799192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'679","last_scrub_stamp":"2024-01-19T05:02:05.799032+0000","last_deep_scrub":"31'679","last_deep_scrub_stamp":"2024-01-19T05:02:05.799032+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.799032+0000","objects_scrubbed":3,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:41:48.633812+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'66","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:11.314563+0000","last_change":"2024-01-19T05:02:11.314647+0000","last_active":"2024-01-19T05:02:11.314563+0000","last_peered":"2024-01-19T05:02:11.314563+0000","last_clean":"2024-01-19T05:02:11.314563+0000","last_became_active":"2024-01-19T04:32:37.509981+0000","last_became_peered":"2024-01-19T04:32:37.509981+0000","last_unstale":"2024-01-19T05:02:11.314563+0000","last_undegraded":"2024-01-19T05:02:11.314563+0000","last_fullsized":"2024-01-19T05:02:11.314563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2024-01-19T05:02:11.314394+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2024-01-19T05:02:11.314394+0000","last_clean_scrub_stamp":"2024-01-19T05:02:11.314394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:57:09.210132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'23","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:57.830236+0000","last_change":"2024-01-19T05:01:57.830259+0000","last_active":"2024-01-19T05:01:57.830236+0000","last_peered":"2024-01-19T05:01:57.830236+0000","last_clean":"2024-01-19T05:01:57.830236+0000","last_became_active":"2024-01-19T04:31:33.154149+0000","last_became_peered":"2024-01-19T04:31:33.154149+0000","last_unstale":"2024-01-19T05:01:57.830236+0000","last_undegraded":"2024-01-19T05:01:57.830236+0000","last_fullsized":"2024-01-19T05:01:57.830236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:01:57.830175+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:01:57.830175+0000","last_clean_scrub_stamp":"2024-01-19T05:01:57.830175+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:55.703158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'9","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.473163+0000","last_change":"2024-01-19T05:01:59.473163+0000","last_active":"2024-01-19T05:01:59.473163+0000","last_peered":"2024-01-19T05:01:59.473163+0000","last_clean":"2024-01-19T05:01:59.473163+0000","last_became_active":"2024-01-19T04:31:31.807021+0000","last_became_peered":"2024-01-19T04:31:31.807021+0000","last_unstale":"2024-01-19T05:01:59.473163+0000","last_undegraded":"2024-01-19T05:01:59.473163+0000","last_fullsized":"2024-01-19T05:01:59.473163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-01-19T05:01:59.473024+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-01-19T05:01:59.473024+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.473024+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:21.093019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'75","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.322935+0000","last_change":"2024-01-19T05:02:08.322999+0000","last_active":"2024-01-19T05:02:08.322935+0000","last_peered":"2024-01-19T05:02:08.322935+0000","last_clean":"2024-01-19T05:02:08.322935+0000","last_became_active":"2024-01-19T04:31:39.833053+0000","last_became_peered":"2024-01-19T04:31:39.833053+0000","last_unstale":"2024-01-19T05:02:08.322935+0000","last_undegraded":"2024-01-19T05:02:08.322935+0000","last_fullsized":"2024-01-19T05:02:08.322935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'75","last_scrub_stamp":"2024-01-19T05:02:08.322754+0000","last_deep_scrub":"31'75","last_deep_scrub_stamp":"2024-01-19T05:02:08.322754+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.322754+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:36.166747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'24","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.912180+0000","last_change":"2024-01-19T05:02:05.912242+0000","last_active":"2024-01-19T05:02:05.912180+0000","last_peered":"2024-01-19T05:02:05.912180+0000","last_clean":"2024-01-19T05:02:05.912180+0000","last_became_active":"2024-01-19T04:31:33.149214+0000","last_became_peered":"2024-01-19T04:31:33.149214+0000","last_unstale":"2024-01-19T05:02:05.912180+0000","last_undegraded":"2024-01-19T05:02:05.912180+0000","last_fullsized":"2024-01-19T05:02:05.912180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:05.912011+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:05.912011+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.912011+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:26.021737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'13","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:57.453559+0000","last_change":"2024-01-19T05:01:57.453608+0000","last_active":"2024-01-19T05:01:57.453559+0000","last_peered":"2024-01-19T05:01:57.453559+0000","last_clean":"2024-01-19T05:01:57.453559+0000","last_became_active":"2024-01-19T04:31:31.803839+0000","last_became_peered":"2024-01-19T04:31:31.803839+0000","last_unstale":"2024-01-19T05:01:57.453559+0000","last_undegraded":"2024-01-19T05:01:57.453559+0000","last_fullsized":"2024-01-19T05:01:57.453559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-01-19T05:01:57.453467+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-01-19T05:01:57.453467+0000","last_clean_scrub_stamp":"2024-01-19T05:01:57.453467+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:38:48.536553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'84","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.551447+0000","last_change":"2024-01-19T05:02:08.551518+0000","last_active":"2024-01-19T05:02:08.551447+0000","last_peered":"2024-01-19T05:02:08.551447+0000","last_clean":"2024-01-19T05:02:08.551447+0000","last_became_active":"2024-01-19T04:31:39.830878+0000","last_became_peered":"2024-01-19T04:31:39.830878+0000","last_unstale":"2024-01-19T05:02:08.551447+0000","last_undegraded":"2024-01-19T05:02:08.551447+0000","last_fullsized":"2024-01-19T05:02:08.551447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2024-01-19T05:02:08.551268+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2024-01-19T05:02:08.551268+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.551268+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:57:06.447005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'24","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.250330+0000","last_change":"2024-01-19T05:02:01.250445+0000","last_active":"2024-01-19T05:02:01.250330+0000","last_peered":"2024-01-19T05:02:01.250330+0000","last_clean":"2024-01-19T05:02:01.250330+0000","last_became_active":"2024-01-19T04:31:33.070915+0000","last_became_peered":"2024-01-19T04:31:33.070915+0000","last_unstale":"2024-01-19T05:02:01.250330+0000","last_undegraded":"2024-01-19T05:02:01.250330+0000","last_fullsized":"2024-01-19T05:02:01.250330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:01.250142+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:01.250142+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.250142+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:51:38.836340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.777243+0000","last_change":"2024-01-19T05:02:01.777367+0000","last_active":"2024-01-19T05:02:01.777243+0000","last_peered":"2024-01-19T05:02:01.777243+0000","last_clean":"2024-01-19T05:02:01.777243+0000","last_became_active":"2024-01-19T04:31:31.775077+0000","last_became_peered":"2024-01-19T04:31:31.775077+0000","last_unstale":"2024-01-19T05:02:01.777243+0000","last_undegraded":"2024-01-19T05:02:01.777243+0000","last_fullsized":"2024-01-19T05:02:01.777243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-01-19T05:02:01.776998+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-01-19T05:02:01.776998+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.776998+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:09:49.615658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'64","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:10.358112+0000","last_change":"2024-01-19T05:02:10.358231+0000","last_active":"2024-01-19T05:02:10.358112+0000","last_peered":"2024-01-19T05:02:10.358112+0000","last_clean":"2024-01-19T05:02:10.358112+0000","last_became_active":"2024-01-19T04:32:37.172049+0000","last_became_peered":"2024-01-19T04:32:37.172049+0000","last_unstale":"2024-01-19T05:02:10.358112+0000","last_undegraded":"2024-01-19T05:02:10.358112+0000","last_fullsized":"2024-01-19T05:02:10.358112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-01-19T05:02:10.357903+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-01-19T05:02:10.357903+0000","last_clean_scrub_stamp":"2024-01-19T05:02:10.357903+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:03:59.374963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.923882+0000","last_change":"2024-01-19T05:01:58.923924+0000","last_active":"2024-01-19T05:01:58.923882+0000","last_peered":"2024-01-19T05:01:58.923882+0000","last_clean":"2024-01-19T05:01:58.923882+0000","last_became_active":"2024-01-19T04:31:33.034042+0000","last_became_peered":"2024-01-19T04:31:33.034042+0000","last_unstale":"2024-01-19T05:01:58.923882+0000","last_undegraded":"2024-01-19T05:01:58.923882+0000","last_fullsized":"2024-01-19T05:01:58.923882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-01-19T05:01:58.923773+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-01-19T05:01:58.923773+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.923773+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:48:23.659326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'18","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.701148+0000","last_change":"2024-01-19T05:01:58.701209+0000","last_active":"2024-01-19T05:01:58.701148+0000","last_peered":"2024-01-19T05:01:58.701148+0000","last_clean":"2024-01-19T05:01:58.701148+0000","last_became_active":"2024-01-19T04:31:31.833563+0000","last_became_peered":"2024-01-19T04:31:31.833563+0000","last_unstale":"2024-01-19T05:01:58.701148+0000","last_undegraded":"2024-01-19T05:01:58.701148+0000","last_fullsized":"2024-01-19T05:01:58.701148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:01:58.701024+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:01:58.701024+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.701024+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:23:32.484636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'70","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.260971+0000","last_change":"2024-01-19T05:02:03.261032+0000","last_active":"2024-01-19T05:02:03.260971+0000","last_peered":"2024-01-19T05:02:03.260971+0000","last_clean":"2024-01-19T05:02:03.260971+0000","last_became_active":"2024-01-19T04:31:39.815252+0000","last_became_peered":"2024-01-19T04:31:39.815252+0000","last_unstale":"2024-01-19T05:02:03.260971+0000","last_undegraded":"2024-01-19T05:02:03.260971+0000","last_fullsized":"2024-01-19T05:02:03.260971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'70","last_scrub_stamp":"2024-01-19T05:02:03.260803+0000","last_deep_scrub":"31'70","last_deep_scrub_stamp":"2024-01-19T05:02:03.260803+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.260803+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:07.390639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'20","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.877746+0000","last_change":"2024-01-19T05:02:06.877804+0000","last_active":"2024-01-19T05:02:06.877746+0000","last_peered":"2024-01-19T05:02:06.877746+0000","last_clean":"2024-01-19T05:02:06.877746+0000","last_became_active":"2024-01-19T04:31:33.150479+0000","last_became_peered":"2024-01-19T04:31:33.150479+0000","last_unstale":"2024-01-19T05:02:06.877746+0000","last_undegraded":"2024-01-19T05:02:06.877746+0000","last_fullsized":"2024-01-19T05:02:06.877746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-01-19T05:02:06.877588+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-01-19T05:02:06.877588+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.877588+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:03:55.894647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'341","reported_seq":385,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.503634+0000","last_change":"2024-01-19T05:02:01.503708+0000","last_active":"2024-01-19T05:02:01.503634+0000","last_peered":"2024-01-19T05:02:01.503634+0000","last_clean":"2024-01-19T05:02:01.503634+0000","last_became_active":"2024-01-19T04:31:31.832115+0000","last_became_peered":"2024-01-19T04:31:31.832115+0000","last_unstale":"2024-01-19T05:02:01.503634+0000","last_undegraded":"2024-01-19T05:02:01.503634+0000","last_fullsized":"2024-01-19T05:02:01.503634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'341","last_scrub_stamp":"2024-01-19T05:02:01.503482+0000","last_deep_scrub":"31'341","last_deep_scrub_stamp":"2024-01-19T05:02:01.503482+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.503482+0000","objects_scrubbed":4,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:09:13.042865+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":914,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'103","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:13.864750+0000","last_change":"2024-01-19T05:02:13.864816+0000","last_active":"2024-01-19T05:02:13.864750+0000","last_peered":"2024-01-19T05:02:13.864750+0000","last_clean":"2024-01-19T05:02:13.864750+0000","last_became_active":"2024-01-19T04:31:39.829461+0000","last_became_peered":"2024-01-19T04:31:39.829461+0000","last_unstale":"2024-01-19T05:02:13.864750+0000","last_undegraded":"2024-01-19T05:02:13.864750+0000","last_fullsized":"2024-01-19T05:02:13.864750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'103","last_scrub_stamp":"2024-01-19T05:02:13.864581+0000","last_deep_scrub":"31'103","last_deep_scrub_stamp":"2024-01-19T05:02:13.864581+0000","last_clean_scrub_stamp":"2024-01-19T05:02:13.864581+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:39:00.870032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:54.385357+0000","last_change":"2024-01-19T05:01:54.385377+0000","last_active":"2024-01-19T05:01:54.385357+0000","last_peered":"2024-01-19T05:01:54.385357+0000","last_clean":"2024-01-19T05:01:54.385357+0000","last_became_active":"2024-01-19T04:31:34.850266+0000","last_became_peered":"2024-01-19T04:31:34.850266+0000","last_unstale":"2024-01-19T05:01:54.385357+0000","last_undegraded":"2024-01-19T05:01:54.385357+0000","last_fullsized":"2024-01-19T05:01:54.385357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-01-19T05:01:54.385297+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-01-19T05:01:54.385297+0000","last_clean_scrub_stamp":"2024-01-19T05:01:54.385297+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:12:42.804116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'10","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.824720+0000","last_change":"2024-01-19T05:02:02.824851+0000","last_active":"2024-01-19T05:02:02.824720+0000","last_peered":"2024-01-19T05:02:02.824720+0000","last_clean":"2024-01-19T05:02:02.824720+0000","last_became_active":"2024-01-19T04:31:31.775972+0000","last_became_peered":"2024-01-19T04:31:31.775972+0000","last_unstale":"2024-01-19T05:02:02.824720+0000","last_undegraded":"2024-01-19T05:02:02.824720+0000","last_fullsized":"2024-01-19T05:02:02.824720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-01-19T05:02:02.824532+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-01-19T05:02:02.824532+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.824532+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:37:18.313481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'70","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.906721+0000","last_change":"2024-01-19T05:02:05.906782+0000","last_active":"2024-01-19T05:02:05.906721+0000","last_peered":"2024-01-19T05:02:05.906721+0000","last_clean":"2024-01-19T05:02:05.906721+0000","last_became_active":"2024-01-19T04:31:39.821467+0000","last_became_peered":"2024-01-19T04:31:39.821467+0000","last_unstale":"2024-01-19T05:02:05.906721+0000","last_undegraded":"2024-01-19T05:02:05.906721+0000","last_fullsized":"2024-01-19T05:02:05.906721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'70","last_scrub_stamp":"2024-01-19T05:02:05.906552+0000","last_deep_scrub":"31'70","last_deep_scrub_stamp":"2024-01-19T05:02:05.906552+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.906552+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:30:07.273063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'19","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.456329+0000","last_change":"2024-01-19T05:02:02.456390+0000","last_active":"2024-01-19T05:02:02.456329+0000","last_peered":"2024-01-19T05:02:02.456329+0000","last_clean":"2024-01-19T05:02:02.456329+0000","last_became_active":"2024-01-19T04:32:36.018566+0000","last_became_peered":"2024-01-19T04:32:36.018566+0000","last_unstale":"2024-01-19T05:02:02.456329+0000","last_undegraded":"2024-01-19T05:02:02.456329+0000","last_fullsized":"2024-01-19T05:02:02.456329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'19","last_scrub_stamp":"2024-01-19T05:02:02.456158+0000","last_deep_scrub":"31'19","last_deep_scrub_stamp":"2024-01-19T05:02:02.456158+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.456158+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:21.635324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"31'4","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.487098+0000","last_change":"2024-01-19T05:02:00.487235+0000","last_active":"2024-01-19T05:02:00.487098+0000","last_peered":"2024-01-19T05:02:00.487098+0000","last_clean":"2024-01-19T05:02:00.487098+0000","last_became_active":"2024-01-19T04:31:31.807260+0000","last_became_peered":"2024-01-19T04:31:31.807260+0000","last_unstale":"2024-01-19T05:02:00.487098+0000","last_undegraded":"2024-01-19T05:02:00.487098+0000","last_fullsized":"2024-01-19T05:02:00.487098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-01-19T05:02:00.486870+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-01-19T05:02:00.486870+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.486870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:53.101271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'99","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:09.516599+0000","last_change":"2024-01-19T05:02:09.516661+0000","last_active":"2024-01-19T05:02:09.516599+0000","last_peered":"2024-01-19T05:02:09.516599+0000","last_clean":"2024-01-19T05:02:09.516599+0000","last_became_active":"2024-01-19T04:31:39.834174+0000","last_became_peered":"2024-01-19T04:31:39.834174+0000","last_unstale":"2024-01-19T05:02:09.516599+0000","last_undegraded":"2024-01-19T05:02:09.516599+0000","last_fullsized":"2024-01-19T05:02:09.516599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2024-01-19T05:02:09.516434+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2024-01-19T05:02:09.516434+0000","last_clean_scrub_stamp":"2024-01-19T05:02:09.516434+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:05:17.730985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.245813+0000","last_change":"2024-01-19T05:01:59.245856+0000","last_active":"2024-01-19T05:01:59.245813+0000","last_peered":"2024-01-19T05:01:59.245813+0000","last_clean":"2024-01-19T05:01:59.245813+0000","last_became_active":"2024-01-19T04:31:33.041047+0000","last_became_peered":"2024-01-19T04:31:33.041047+0000","last_unstale":"2024-01-19T05:01:59.245813+0000","last_undegraded":"2024-01-19T05:01:59.245813+0000","last_fullsized":"2024-01-19T05:01:59.245813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-01-19T05:01:59.245714+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-01-19T05:01:59.245714+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.245714+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:35:50.939221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'10","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.501332+0000","last_change":"2024-01-19T05:02:01.501419+0000","last_active":"2024-01-19T05:02:01.501332+0000","last_peered":"2024-01-19T05:02:01.501332+0000","last_clean":"2024-01-19T05:02:01.501332+0000","last_became_active":"2024-01-19T04:31:31.803567+0000","last_became_peered":"2024-01-19T04:31:31.803567+0000","last_unstale":"2024-01-19T05:02:01.501332+0000","last_undegraded":"2024-01-19T05:02:01.501332+0000","last_fullsized":"2024-01-19T05:02:01.501332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-01-19T05:02:01.501043+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-01-19T05:02:01.501043+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.501043+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:10.186851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'56","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.506731+0000","last_change":"2024-01-19T05:02:07.506815+0000","last_active":"2024-01-19T05:02:07.506731+0000","last_peered":"2024-01-19T05:02:07.506731+0000","last_clean":"2024-01-19T05:02:07.506731+0000","last_became_active":"2024-01-19T04:31:39.830292+0000","last_became_peered":"2024-01-19T04:31:39.830292+0000","last_unstale":"2024-01-19T05:02:07.506731+0000","last_undegraded":"2024-01-19T05:02:07.506731+0000","last_fullsized":"2024-01-19T05:02:07.506731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2024-01-19T05:02:07.506540+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2024-01-19T05:02:07.506540+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.506540+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:03:56.523600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'25","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:55.419997+0000","last_change":"2024-01-19T05:01:55.420028+0000","last_active":"2024-01-19T05:01:55.419997+0000","last_peered":"2024-01-19T05:01:55.419997+0000","last_clean":"2024-01-19T05:01:55.419997+0000","last_became_active":"2024-01-19T04:31:34.849911+0000","last_became_peered":"2024-01-19T04:31:34.849911+0000","last_unstale":"2024-01-19T05:01:55.419997+0000","last_undegraded":"2024-01-19T05:01:55.419997+0000","last_fullsized":"2024-01-19T05:01:55.419997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-01-19T05:01:55.419913+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-01-19T05:01:55.419913+0000","last_clean_scrub_stamp":"2024-01-19T05:01:55.419913+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:35:47.113420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'573","reported_seq":1178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:55.401235+0000","last_change":"2024-01-19T05:01:55.401283+0000","last_active":"2024-01-19T05:01:55.401235+0000","last_peered":"2024-01-19T05:01:55.401235+0000","last_clean":"2024-01-19T05:01:55.401235+0000","last_became_active":"2024-01-19T04:31:31.731511+0000","last_became_peered":"2024-01-19T04:31:31.731511+0000","last_unstale":"2024-01-19T05:01:55.401235+0000","last_undegraded":"2024-01-19T05:01:55.401235+0000","last_fullsized":"2024-01-19T05:01:55.401235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'573","last_scrub_stamp":"2024-01-19T05:01:55.401143+0000","last_deep_scrub":"31'573","last_deep_scrub_stamp":"2024-01-19T05:01:55.401143+0000","last_clean_scrub_stamp":"2024-01-19T05:01:55.401143+0000","objects_scrubbed":4,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:45:37.605551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129245,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":569,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'65","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:10.538444+0000","last_change":"2024-01-19T05:02:10.538564+0000","last_active":"2024-01-19T05:02:10.538444+0000","last_peered":"2024-01-19T05:02:10.538444+0000","last_clean":"2024-01-19T05:02:10.538444+0000","last_became_active":"2024-01-19T04:31:39.836354+0000","last_became_peered":"2024-01-19T04:31:39.836354+0000","last_unstale":"2024-01-19T05:02:10.538444+0000","last_undegraded":"2024-01-19T05:02:10.538444+0000","last_fullsized":"2024-01-19T05:02:10.538444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2024-01-19T05:02:10.538251+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2024-01-19T05:02:10.538251+0000","last_clean_scrub_stamp":"2024-01-19T05:02:10.538251+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:14.988352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":6769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'15","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.949331+0000","last_change":"2024-01-19T05:02:00.949391+0000","last_active":"2024-01-19T05:02:00.949331+0000","last_peered":"2024-01-19T05:02:00.949331+0000","last_clean":"2024-01-19T05:02:00.949331+0000","last_became_active":"2024-01-19T04:31:33.039380+0000","last_became_peered":"2024-01-19T04:31:33.039380+0000","last_unstale":"2024-01-19T05:02:00.949331+0000","last_undegraded":"2024-01-19T05:02:00.949331+0000","last_fullsized":"2024-01-19T05:02:00.949331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-01-19T05:02:00.949173+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-01-19T05:02:00.949173+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.949173+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:02:54.657452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.825603+0000","last_change":"2024-01-19T05:02:04.825665+0000","last_active":"2024-01-19T05:02:04.825603+0000","last_peered":"2024-01-19T05:02:04.825603+0000","last_clean":"2024-01-19T05:02:04.825603+0000","last_became_active":"2024-01-19T04:31:31.800754+0000","last_became_peered":"2024-01-19T04:31:31.800754+0000","last_unstale":"2024-01-19T05:02:04.825603+0000","last_undegraded":"2024-01-19T05:02:04.825603+0000","last_fullsized":"2024-01-19T05:02:04.825603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-01-19T05:02:04.825435+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-01-19T05:02:04.825435+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.825435+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:57.505918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'104","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.858704+0000","last_change":"2024-01-19T05:02:04.858766+0000","last_active":"2024-01-19T05:02:04.858704+0000","last_peered":"2024-01-19T05:02:04.858704+0000","last_clean":"2024-01-19T05:02:04.858704+0000","last_became_active":"2024-01-19T04:31:39.820418+0000","last_became_peered":"2024-01-19T04:31:39.820418+0000","last_unstale":"2024-01-19T05:02:04.858704+0000","last_undegraded":"2024-01-19T05:02:04.858704+0000","last_fullsized":"2024-01-19T05:02:04.858704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'104","last_scrub_stamp":"2024-01-19T05:02:04.858541+0000","last_deep_scrub":"31'104","last_deep_scrub_stamp":"2024-01-19T05:02:04.858541+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.858541+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:23:54.570497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":11574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.914418+0000","last_change":"2024-01-19T05:02:08.914480+0000","last_active":"2024-01-19T05:02:08.914418+0000","last_peered":"2024-01-19T05:02:08.914418+0000","last_clean":"2024-01-19T05:02:08.914418+0000","last_became_active":"2024-01-19T04:31:33.249024+0000","last_became_peered":"2024-01-19T04:31:33.249024+0000","last_unstale":"2024-01-19T05:02:08.914418+0000","last_undegraded":"2024-01-19T05:02:08.914418+0000","last_fullsized":"2024-01-19T05:02:08.914418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-01-19T05:02:08.914250+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-01-19T05:02:08.914250+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.914250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:05:17.128801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.574175+0000","last_change":"2024-01-19T05:01:58.574254+0000","last_active":"2024-01-19T05:01:58.574175+0000","last_peered":"2024-01-19T05:01:58.574175+0000","last_clean":"2024-01-19T05:01:58.574175+0000","last_became_active":"2024-01-19T04:31:31.801061+0000","last_became_peered":"2024-01-19T04:31:31.801061+0000","last_unstale":"2024-01-19T05:01:58.574175+0000","last_undegraded":"2024-01-19T05:01:58.574175+0000","last_fullsized":"2024-01-19T05:01:58.574175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-01-19T05:01:58.574024+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-01-19T05:01:58.574024+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.574024+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:51:40.711662+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.791967+0000","last_change":"2024-01-19T05:02:00.792034+0000","last_active":"2024-01-19T05:02:00.791967+0000","last_peered":"2024-01-19T05:02:00.791967+0000","last_clean":"2024-01-19T05:02:00.791967+0000","last_became_active":"2024-01-19T04:30:49.974765+0000","last_became_peered":"2024-01-19T04:30:49.974765+0000","last_unstale":"2024-01-19T05:02:00.791967+0000","last_undegraded":"2024-01-19T05:02:00.791967+0000","last_fullsized":"2024-01-19T05:02:00.791967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-01-19T05:02:00.791844+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-01-19T05:02:00.791844+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.791844+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:16:41.498784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'86","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:10.796947+0000","last_change":"2024-01-19T05:02:10.797015+0000","last_active":"2024-01-19T05:02:10.796947+0000","last_peered":"2024-01-19T05:02:10.796947+0000","last_clean":"2024-01-19T05:02:10.796947+0000","last_became_active":"2024-01-19T04:31:39.830275+0000","last_became_peered":"2024-01-19T04:31:39.830275+0000","last_unstale":"2024-01-19T05:02:10.796947+0000","last_undegraded":"2024-01-19T05:02:10.796947+0000","last_fullsized":"2024-01-19T05:02:10.796947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'86","last_scrub_stamp":"2024-01-19T05:02:10.796763+0000","last_deep_scrub":"31'86","last_deep_scrub_stamp":"2024-01-19T05:02:10.796763+0000","last_clean_scrub_stamp":"2024-01-19T05:02:10.796763+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:38.640756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'24","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:14.744058+0000","last_change":"2024-01-19T05:02:14.744118+0000","last_active":"2024-01-19T05:02:14.744058+0000","last_peered":"2024-01-19T05:02:14.744058+0000","last_clean":"2024-01-19T05:02:14.744058+0000","last_became_active":"2024-01-19T04:31:33.247907+0000","last_became_peered":"2024-01-19T04:31:33.247907+0000","last_unstale":"2024-01-19T05:02:14.744058+0000","last_undegraded":"2024-01-19T05:02:14.744058+0000","last_fullsized":"2024-01-19T05:02:14.744058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:14.743900+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:14.743900+0000","last_clean_scrub_stamp":"2024-01-19T05:02:14.743900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:00:18.213257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'14","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.403646+0000","last_change":"2024-01-19T05:01:58.403712+0000","last_active":"2024-01-19T05:01:58.403646+0000","last_peered":"2024-01-19T05:01:58.403646+0000","last_clean":"2024-01-19T05:01:58.403646+0000","last_became_active":"2024-01-19T04:31:31.801611+0000","last_became_peered":"2024-01-19T04:31:31.801611+0000","last_unstale":"2024-01-19T05:01:58.403646+0000","last_undegraded":"2024-01-19T05:01:58.403646+0000","last_fullsized":"2024-01-19T05:01:58.403646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-01-19T05:01:58.403489+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-01-19T05:01:58.403489+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.403489+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:44:05.516735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'80","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:11.754023+0000","last_change":"2024-01-19T05:02:11.754083+0000","last_active":"2024-01-19T05:02:11.754023+0000","last_peered":"2024-01-19T05:02:11.754023+0000","last_clean":"2024-01-19T05:02:11.754023+0000","last_became_active":"2024-01-19T04:31:39.829039+0000","last_became_peered":"2024-01-19T04:31:39.829039+0000","last_unstale":"2024-01-19T05:02:11.754023+0000","last_undegraded":"2024-01-19T05:02:11.754023+0000","last_fullsized":"2024-01-19T05:02:11.754023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'80","last_scrub_stamp":"2024-01-19T05:02:11.753826+0000","last_deep_scrub":"31'80","last_deep_scrub_stamp":"2024-01-19T05:02:11.753826+0000","last_clean_scrub_stamp":"2024-01-19T05:02:11.753826+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:31.863552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'22","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:13.364785+0000","last_change":"2024-01-19T05:02:13.364845+0000","last_active":"2024-01-19T05:02:13.364785+0000","last_peered":"2024-01-19T05:02:13.364785+0000","last_clean":"2024-01-19T05:02:13.364785+0000","last_became_active":"2024-01-19T04:32:36.982330+0000","last_became_peered":"2024-01-19T04:32:36.982330+0000","last_unstale":"2024-01-19T05:02:13.364785+0000","last_undegraded":"2024-01-19T05:02:13.364785+0000","last_fullsized":"2024-01-19T05:02:13.364785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-01-19T05:02:13.364623+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-01-19T05:02:13.364623+0000","last_clean_scrub_stamp":"2024-01-19T05:02:13.364623+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:17.814724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:56.459402+0000","last_change":"2024-01-19T05:01:56.459437+0000","last_active":"2024-01-19T05:01:56.459402+0000","last_peered":"2024-01-19T05:01:56.459402+0000","last_clean":"2024-01-19T05:01:56.459402+0000","last_became_active":"2024-01-19T04:31:31.801818+0000","last_became_peered":"2024-01-19T04:31:31.801818+0000","last_unstale":"2024-01-19T05:01:56.459402+0000","last_undegraded":"2024-01-19T05:01:56.459402+0000","last_fullsized":"2024-01-19T05:01:56.459402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-01-19T05:01:56.459295+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-01-19T05:01:56.459295+0000","last_clean_scrub_stamp":"2024-01-19T05:01:56.459295+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:51:38.596933+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'75","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.861253+0000","last_change":"2024-01-19T05:02:06.861377+0000","last_active":"2024-01-19T05:02:06.861253+0000","last_peered":"2024-01-19T05:02:06.861253+0000","last_clean":"2024-01-19T05:02:06.861253+0000","last_became_active":"2024-01-19T04:31:39.821496+0000","last_became_peered":"2024-01-19T04:31:39.821496+0000","last_unstale":"2024-01-19T05:02:06.861253+0000","last_undegraded":"2024-01-19T05:02:06.861253+0000","last_fullsized":"2024-01-19T05:02:06.861253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'75","last_scrub_stamp":"2024-01-19T05:02:06.861023+0000","last_deep_scrub":"31'75","last_deep_scrub_stamp":"2024-01-19T05:02:06.861023+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.861023+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:46:57.064170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":9598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'25","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.802789+0000","last_change":"2024-01-19T05:01:59.802891+0000","last_active":"2024-01-19T05:01:59.802789+0000","last_peered":"2024-01-19T05:01:59.802789+0000","last_clean":"2024-01-19T05:01:59.802789+0000","last_became_active":"2024-01-19T04:31:33.038179+0000","last_became_peered":"2024-01-19T04:31:33.038179+0000","last_unstale":"2024-01-19T05:01:59.802789+0000","last_undegraded":"2024-01-19T05:01:59.802789+0000","last_fullsized":"2024-01-19T05:01:59.802789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-01-19T05:01:59.802590+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-01-19T05:01:59.802590+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.802590+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:10:18.048161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'12","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:56.379985+0000","last_change":"2024-01-19T05:01:56.380010+0000","last_active":"2024-01-19T05:01:56.379985+0000","last_peered":"2024-01-19T05:01:56.379985+0000","last_clean":"2024-01-19T05:01:56.379985+0000","last_became_active":"2024-01-19T04:31:31.731556+0000","last_became_peered":"2024-01-19T04:31:31.731556+0000","last_unstale":"2024-01-19T05:01:56.379985+0000","last_undegraded":"2024-01-19T05:01:56.379985+0000","last_fullsized":"2024-01-19T05:01:56.379985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-01-19T05:01:56.379929+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-01-19T05:01:56.379929+0000","last_clean_scrub_stamp":"2024-01-19T05:01:56.379929+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:27.926468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'73","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:11.387997+0000","last_change":"2024-01-19T05:02:11.388063+0000","last_active":"2024-01-19T05:02:11.387997+0000","last_peered":"2024-01-19T05:02:11.387997+0000","last_clean":"2024-01-19T05:02:11.387997+0000","last_became_active":"2024-01-19T04:31:39.817975+0000","last_became_peered":"2024-01-19T04:31:39.817975+0000","last_unstale":"2024-01-19T05:02:11.387997+0000","last_undegraded":"2024-01-19T05:02:11.387997+0000","last_fullsized":"2024-01-19T05:02:11.387997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-01-19T05:02:11.387822+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-01-19T05:02:11.387822+0000","last_clean_scrub_stamp":"2024-01-19T05:02:11.387822+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:57:09.283560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":7505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'18","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.768288+0000","last_change":"2024-01-19T05:02:08.768350+0000","last_active":"2024-01-19T05:02:08.768288+0000","last_peered":"2024-01-19T05:02:08.768288+0000","last_clean":"2024-01-19T05:02:08.768288+0000","last_became_active":"2024-01-19T04:31:33.038415+0000","last_became_peered":"2024-01-19T04:31:33.038415+0000","last_unstale":"2024-01-19T05:02:08.768288+0000","last_undegraded":"2024-01-19T05:02:08.768288+0000","last_fullsized":"2024-01-19T05:02:08.768288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:02:08.768130+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:02:08.768130+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.768130+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:13.575719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:57.237271+0000","last_change":"2024-01-19T05:01:57.237334+0000","last_active":"2024-01-19T05:01:57.237271+0000","last_peered":"2024-01-19T05:01:57.237271+0000","last_clean":"2024-01-19T05:01:57.237271+0000","last_became_active":"2024-01-19T04:31:31.807345+0000","last_became_peered":"2024-01-19T04:31:31.807345+0000","last_unstale":"2024-01-19T05:01:57.237271+0000","last_undegraded":"2024-01-19T05:01:57.237271+0000","last_fullsized":"2024-01-19T05:01:57.237271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-01-19T05:01:57.237113+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-01-19T05:01:57.237113+0000","last_clean_scrub_stamp":"2024-01-19T05:01:57.237113+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:23:31.020725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'111","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:09.312956+0000","last_change":"2024-01-19T05:02:09.313020+0000","last_active":"2024-01-19T05:02:09.312956+0000","last_peered":"2024-01-19T05:02:09.312956+0000","last_clean":"2024-01-19T05:02:09.312956+0000","last_became_active":"2024-01-19T04:31:39.835734+0000","last_became_peered":"2024-01-19T04:31:39.835734+0000","last_unstale":"2024-01-19T05:02:09.312956+0000","last_undegraded":"2024-01-19T05:02:09.312956+0000","last_fullsized":"2024-01-19T05:02:09.312956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'111","last_scrub_stamp":"2024-01-19T05:02:09.312787+0000","last_deep_scrub":"31'111","last_deep_scrub_stamp":"2024-01-19T05:02:09.312787+0000","last_clean_scrub_stamp":"2024-01-19T05:02:09.312787+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:29.422513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'23","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:10.768862+0000","last_change":"2024-01-19T05:02:10.768920+0000","last_active":"2024-01-19T05:02:10.768862+0000","last_peered":"2024-01-19T05:02:10.768862+0000","last_clean":"2024-01-19T05:02:10.768862+0000","last_became_active":"2024-01-19T04:31:33.043257+0000","last_became_peered":"2024-01-19T04:31:33.043257+0000","last_unstale":"2024-01-19T05:02:10.768862+0000","last_undegraded":"2024-01-19T05:02:10.768862+0000","last_fullsized":"2024-01-19T05:02:10.768862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:10.768698+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:10.768698+0000","last_clean_scrub_stamp":"2024-01-19T05:02:10.768698+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:30:12.135210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'27","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:57.436374+0000","last_change":"2024-01-19T05:01:57.436437+0000","last_active":"2024-01-19T05:01:57.436374+0000","last_peered":"2024-01-19T05:01:57.436374+0000","last_clean":"2024-01-19T05:01:57.436374+0000","last_became_active":"2024-01-19T04:31:31.800207+0000","last_became_peered":"2024-01-19T04:31:31.800207+0000","last_unstale":"2024-01-19T05:01:57.436374+0000","last_undegraded":"2024-01-19T05:01:57.436374+0000","last_fullsized":"2024-01-19T05:01:57.436374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-01-19T05:01:57.436282+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-01-19T05:01:57.436282+0000","last_clean_scrub_stamp":"2024-01-19T05:01:57.436282+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:38.936493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'79","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.908192+0000","last_change":"2024-01-19T05:02:07.908258+0000","last_active":"2024-01-19T05:02:07.908192+0000","last_peered":"2024-01-19T05:02:07.908192+0000","last_clean":"2024-01-19T05:02:07.908192+0000","last_became_active":"2024-01-19T04:31:39.822642+0000","last_became_peered":"2024-01-19T04:31:39.822642+0000","last_unstale":"2024-01-19T05:02:07.908192+0000","last_undegraded":"2024-01-19T05:02:07.908192+0000","last_fullsized":"2024-01-19T05:02:07.908192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'79","last_scrub_stamp":"2024-01-19T05:02:07.908024+0000","last_deep_scrub":"31'79","last_deep_scrub_stamp":"2024-01-19T05:02:07.908024+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.908024+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:03:35.823210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":5475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'23","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.642523+0000","last_change":"2024-01-19T05:02:03.642586+0000","last_active":"2024-01-19T05:02:03.642523+0000","last_peered":"2024-01-19T05:02:03.642523+0000","last_clean":"2024-01-19T05:02:03.642523+0000","last_became_active":"2024-01-19T04:31:33.213723+0000","last_became_peered":"2024-01-19T04:31:33.213723+0000","last_unstale":"2024-01-19T05:02:03.642523+0000","last_undegraded":"2024-01-19T05:02:03.642523+0000","last_fullsized":"2024-01-19T05:02:03.642523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:03.642351+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:03.642351+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.642351+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:52:26.271976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'15","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.625840+0000","last_change":"2024-01-19T05:02:00.625910+0000","last_active":"2024-01-19T05:02:00.625840+0000","last_peered":"2024-01-19T05:02:00.625840+0000","last_clean":"2024-01-19T05:02:00.625840+0000","last_became_active":"2024-01-19T04:31:31.835768+0000","last_became_peered":"2024-01-19T04:31:31.835768+0000","last_unstale":"2024-01-19T05:02:00.625840+0000","last_undegraded":"2024-01-19T05:02:00.625840+0000","last_fullsized":"2024-01-19T05:02:00.625840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-01-19T05:02:00.625682+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-01-19T05:02:00.625682+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.625682+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:09.504361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'73","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:15.773315+0000","last_change":"2024-01-19T05:02:15.773443+0000","last_active":"2024-01-19T05:02:15.773315+0000","last_peered":"2024-01-19T05:02:15.773315+0000","last_clean":"2024-01-19T05:02:15.773315+0000","last_became_active":"2024-01-19T04:32:37.172443+0000","last_became_peered":"2024-01-19T04:32:37.172443+0000","last_unstale":"2024-01-19T05:02:15.773315+0000","last_undegraded":"2024-01-19T05:02:15.773315+0000","last_fullsized":"2024-01-19T05:02:15.773315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-01-19T05:02:15.773047+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-01-19T05:02:15.773047+0000","last_clean_scrub_stamp":"2024-01-19T05:02:15.773047+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:33:35.050515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:09.775934+0000","last_change":"2024-01-19T05:02:09.775997+0000","last_active":"2024-01-19T05:02:09.775934+0000","last_peered":"2024-01-19T05:02:09.775934+0000","last_clean":"2024-01-19T05:02:09.775934+0000","last_became_active":"2024-01-19T04:31:33.038241+0000","last_became_peered":"2024-01-19T04:31:33.038241+0000","last_unstale":"2024-01-19T05:02:09.775934+0000","last_undegraded":"2024-01-19T05:02:09.775934+0000","last_fullsized":"2024-01-19T05:02:09.775934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-01-19T05:02:09.775774+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-01-19T05:02:09.775774+0000","last_clean_scrub_stamp":"2024-01-19T05:02:09.775774+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:23:59.487729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'15","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.525945+0000","last_change":"2024-01-19T05:02:00.526020+0000","last_active":"2024-01-19T05:02:00.525945+0000","last_peered":"2024-01-19T05:02:00.525945+0000","last_clean":"2024-01-19T05:02:00.525945+0000","last_became_active":"2024-01-19T04:31:31.803130+0000","last_became_peered":"2024-01-19T04:31:31.803130+0000","last_unstale":"2024-01-19T05:02:00.525945+0000","last_undegraded":"2024-01-19T05:02:00.525945+0000","last_fullsized":"2024-01-19T05:02:00.525945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-01-19T05:02:00.525794+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-01-19T05:02:00.525794+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.525794+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:52:23.155419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'64","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:12.815183+0000","last_change":"2024-01-19T05:02:12.815249+0000","last_active":"2024-01-19T05:02:12.815183+0000","last_peered":"2024-01-19T05:02:12.815183+0000","last_clean":"2024-01-19T05:02:12.815183+0000","last_became_active":"2024-01-19T04:31:39.828521+0000","last_became_peered":"2024-01-19T04:31:39.828521+0000","last_unstale":"2024-01-19T05:02:12.815183+0000","last_undegraded":"2024-01-19T05:02:12.815183+0000","last_fullsized":"2024-01-19T05:02:12.815183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'64","last_scrub_stamp":"2024-01-19T05:02:12.814996+0000","last_deep_scrub":"31'64","last_deep_scrub_stamp":"2024-01-19T05:02:12.814996+0000","last_clean_scrub_stamp":"2024-01-19T05:02:12.814996+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:32:15.994526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'26","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:56.965746+0000","last_change":"2024-01-19T05:01:56.965796+0000","last_active":"2024-01-19T05:01:56.965746+0000","last_peered":"2024-01-19T05:01:56.965746+0000","last_clean":"2024-01-19T05:01:56.965746+0000","last_became_active":"2024-01-19T04:31:32.993317+0000","last_became_peered":"2024-01-19T04:31:32.993317+0000","last_unstale":"2024-01-19T05:01:56.965746+0000","last_undegraded":"2024-01-19T05:01:56.965746+0000","last_fullsized":"2024-01-19T05:01:56.965746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2024-01-19T05:01:56.965629+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2024-01-19T05:01:56.965629+0000","last_clean_scrub_stamp":"2024-01-19T05:01:56.965629+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:54:44.673723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:54.942037+0000","last_change":"2024-01-19T05:01:54.942066+0000","last_active":"2024-01-19T05:01:54.942037+0000","last_peered":"2024-01-19T05:01:54.942037+0000","last_clean":"2024-01-19T05:01:54.942037+0000","last_became_active":"2024-01-19T04:31:31.806169+0000","last_became_peered":"2024-01-19T04:31:31.806169+0000","last_unstale":"2024-01-19T05:01:54.942037+0000","last_undegraded":"2024-01-19T05:01:54.942037+0000","last_fullsized":"2024-01-19T05:01:54.942037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-01-19T05:01:54.941974+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-01-19T05:01:54.941974+0000","last_clean_scrub_stamp":"2024-01-19T05:01:54.941974+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:10:13.187545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'85","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:12.346159+0000","last_change":"2024-01-19T05:02:12.346275+0000","last_active":"2024-01-19T05:02:12.346159+0000","last_peered":"2024-01-19T05:02:12.346159+0000","last_clean":"2024-01-19T05:02:12.346159+0000","last_became_active":"2024-01-19T04:31:39.827406+0000","last_became_peered":"2024-01-19T04:31:39.827406+0000","last_unstale":"2024-01-19T05:02:12.346159+0000","last_undegraded":"2024-01-19T05:02:12.346159+0000","last_fullsized":"2024-01-19T05:02:12.346159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'85","last_scrub_stamp":"2024-01-19T05:02:12.345894+0000","last_deep_scrub":"31'85","last_deep_scrub_stamp":"2024-01-19T05:02:12.345894+0000","last_clean_scrub_stamp":"2024-01-19T05:02:12.345894+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:05:20.560445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":10580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'23","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:12.785877+0000","last_change":"2024-01-19T05:02:12.785940+0000","last_active":"2024-01-19T05:02:12.785877+0000","last_peered":"2024-01-19T05:02:12.785877+0000","last_clean":"2024-01-19T05:02:12.785877+0000","last_became_active":"2024-01-19T04:31:33.149542+0000","last_became_peered":"2024-01-19T04:31:33.149542+0000","last_unstale":"2024-01-19T05:02:12.785877+0000","last_undegraded":"2024-01-19T05:02:12.785877+0000","last_fullsized":"2024-01-19T05:02:12.785877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:12.785742+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:12.785742+0000","last_clean_scrub_stamp":"2024-01-19T05:02:12.785742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:03:40.700928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'835","reported_seq":879,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.677882+0000","last_change":"2024-01-19T05:01:59.677882+0000","last_active":"2024-01-19T05:01:59.677882+0000","last_peered":"2024-01-19T05:01:59.677882+0000","last_clean":"2024-01-19T05:01:59.677882+0000","last_became_active":"2024-01-19T04:31:31.835417+0000","last_became_peered":"2024-01-19T04:31:31.835417+0000","last_unstale":"2024-01-19T05:01:59.677882+0000","last_undegraded":"2024-01-19T05:01:59.677882+0000","last_fullsized":"2024-01-19T05:01:59.677882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'835","last_scrub_stamp":"2024-01-19T05:01:59.677648+0000","last_deep_scrub":"31'835","last_deep_scrub_stamp":"2024-01-19T05:01:59.677648+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.677648+0000","objects_scrubbed":6,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:12:28.585001+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":4574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'77","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.532665+0000","last_change":"2024-01-19T05:02:06.532736+0000","last_active":"2024-01-19T05:02:06.532665+0000","last_peered":"2024-01-19T05:02:06.532665+0000","last_clean":"2024-01-19T05:02:06.532665+0000","last_became_active":"2024-01-19T04:31:39.823121+0000","last_became_peered":"2024-01-19T04:31:39.823121+0000","last_unstale":"2024-01-19T05:02:06.532665+0000","last_undegraded":"2024-01-19T05:02:06.532665+0000","last_fullsized":"2024-01-19T05:02:06.532665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'77","last_scrub_stamp":"2024-01-19T05:02:06.532468+0000","last_deep_scrub":"31'77","last_deep_scrub_stamp":"2024-01-19T05:02:06.532468+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.532468+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:26.642195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'25","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.228239+0000","last_change":"2024-01-19T05:02:00.228239+0000","last_active":"2024-01-19T05:02:00.228239+0000","last_peered":"2024-01-19T05:02:00.228239+0000","last_clean":"2024-01-19T05:02:00.228239+0000","last_became_active":"2024-01-19T04:31:33.043292+0000","last_became_peered":"2024-01-19T04:31:33.043292+0000","last_unstale":"2024-01-19T05:02:00.228239+0000","last_undegraded":"2024-01-19T05:02:00.228239+0000","last_fullsized":"2024-01-19T05:02:00.228239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-01-19T05:02:00.228023+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-01-19T05:02:00.228023+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.228023+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:38:51.311109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'391","reported_seq":433,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.427725+0000","last_change":"2024-01-19T05:01:58.427789+0000","last_active":"2024-01-19T05:01:58.427725+0000","last_peered":"2024-01-19T05:01:58.427725+0000","last_clean":"2024-01-19T05:01:58.427725+0000","last_became_active":"2024-01-19T04:31:31.806277+0000","last_became_peered":"2024-01-19T04:31:31.806277+0000","last_unstale":"2024-01-19T05:01:58.427725+0000","last_undegraded":"2024-01-19T05:01:58.427725+0000","last_fullsized":"2024-01-19T05:01:58.427725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'391","last_scrub_stamp":"2024-01-19T05:01:58.427583+0000","last_deep_scrub":"31'391","last_deep_scrub_stamp":"2024-01-19T05:01:58.427583+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.427583+0000","objects_scrubbed":4,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:51:36.013781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":386,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'136","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.243590+0000","last_change":"2024-01-19T05:02:05.243655+0000","last_active":"2024-01-19T05:02:05.243590+0000","last_peered":"2024-01-19T05:02:05.243590+0000","last_clean":"2024-01-19T05:02:05.243590+0000","last_became_active":"2024-01-19T04:31:39.823441+0000","last_became_peered":"2024-01-19T04:31:39.823441+0000","last_unstale":"2024-01-19T05:02:05.243590+0000","last_undegraded":"2024-01-19T05:02:05.243590+0000","last_fullsized":"2024-01-19T05:02:05.243590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'136","last_scrub_stamp":"2024-01-19T05:02:05.243412+0000","last_deep_scrub":"31'136","last_deep_scrub_stamp":"2024-01-19T05:02:05.243412+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.243412+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:01:41.963275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'27","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.875277+0000","last_change":"2024-01-19T05:02:02.875334+0000","last_active":"2024-01-19T05:02:02.875277+0000","last_peered":"2024-01-19T05:02:02.875277+0000","last_clean":"2024-01-19T05:02:02.875277+0000","last_became_active":"2024-01-19T04:31:33.248466+0000","last_became_peered":"2024-01-19T04:31:33.248466+0000","last_unstale":"2024-01-19T05:02:02.875277+0000","last_undegraded":"2024-01-19T05:02:02.875277+0000","last_fullsized":"2024-01-19T05:02:02.875277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-01-19T05:02:02.875120+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-01-19T05:02:02.875120+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.875120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:08:10.019856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'10","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.488721+0000","last_change":"2024-01-19T05:02:02.488789+0000","last_active":"2024-01-19T05:02:02.488721+0000","last_peered":"2024-01-19T05:02:02.488721+0000","last_clean":"2024-01-19T05:02:02.488721+0000","last_became_active":"2024-01-19T04:31:31.832691+0000","last_became_peered":"2024-01-19T04:31:31.832691+0000","last_unstale":"2024-01-19T05:02:02.488721+0000","last_undegraded":"2024-01-19T05:02:02.488721+0000","last_fullsized":"2024-01-19T05:02:02.488721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-01-19T05:02:02.488562+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-01-19T05:02:02.488562+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.488562+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:55.102963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'77","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:10.836281+0000","last_change":"2024-01-19T05:02:10.836342+0000","last_active":"2024-01-19T05:02:10.836281+0000","last_peered":"2024-01-19T05:02:10.836281+0000","last_clean":"2024-01-19T05:02:10.836281+0000","last_became_active":"2024-01-19T04:31:39.822169+0000","last_became_peered":"2024-01-19T04:31:39.822169+0000","last_unstale":"2024-01-19T05:02:10.836281+0000","last_undegraded":"2024-01-19T05:02:10.836281+0000","last_fullsized":"2024-01-19T05:02:10.836281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'77","last_scrub_stamp":"2024-01-19T05:02:10.836119+0000","last_deep_scrub":"31'77","last_deep_scrub_stamp":"2024-01-19T05:02:10.836119+0000","last_clean_scrub_stamp":"2024-01-19T05:02:10.836119+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:11:36.906194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'28","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:06.442700+0000","last_change":"2024-01-19T05:02:06.442760+0000","last_active":"2024-01-19T05:02:06.442700+0000","last_peered":"2024-01-19T05:02:06.442700+0000","last_clean":"2024-01-19T05:02:06.442700+0000","last_became_active":"2024-01-19T04:31:34.743328+0000","last_became_peered":"2024-01-19T04:31:34.743328+0000","last_unstale":"2024-01-19T05:02:06.442700+0000","last_undegraded":"2024-01-19T05:02:06.442700+0000","last_fullsized":"2024-01-19T05:02:06.442700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2024-01-19T05:02:06.442522+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2024-01-19T05:02:06.442522+0000","last_clean_scrub_stamp":"2024-01-19T05:02:06.442522+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:56:04.914606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'18","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.649689+0000","last_change":"2024-01-19T05:02:01.649765+0000","last_active":"2024-01-19T05:02:01.649689+0000","last_peered":"2024-01-19T05:02:01.649689+0000","last_clean":"2024-01-19T05:02:01.649689+0000","last_became_active":"2024-01-19T04:31:31.838561+0000","last_became_peered":"2024-01-19T04:31:31.838561+0000","last_unstale":"2024-01-19T05:02:01.649689+0000","last_undegraded":"2024-01-19T05:02:01.649689+0000","last_fullsized":"2024-01-19T05:02:01.649689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:02:01.649532+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:02:01.649532+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.649532+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:59.522515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'83","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:14.820807+0000","last_change":"2024-01-19T05:02:14.820870+0000","last_active":"2024-01-19T05:02:14.820807+0000","last_peered":"2024-01-19T05:02:14.820807+0000","last_clean":"2024-01-19T05:02:14.820807+0000","last_became_active":"2024-01-19T04:31:39.828609+0000","last_became_peered":"2024-01-19T04:31:39.828609+0000","last_unstale":"2024-01-19T05:02:14.820807+0000","last_undegraded":"2024-01-19T05:02:14.820807+0000","last_fullsized":"2024-01-19T05:02:14.820807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-01-19T05:02:14.820651+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-01-19T05:02:14.820651+0000","last_clean_scrub_stamp":"2024-01-19T05:02:14.820651+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:28:49.991451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'74","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.936004+0000","last_change":"2024-01-19T05:02:08.936066+0000","last_active":"2024-01-19T05:02:08.936004+0000","last_peered":"2024-01-19T05:02:08.936004+0000","last_clean":"2024-01-19T05:02:08.936004+0000","last_became_active":"2024-01-19T04:31:39.827015+0000","last_became_peered":"2024-01-19T04:31:39.827015+0000","last_unstale":"2024-01-19T05:02:08.936004+0000","last_undegraded":"2024-01-19T05:02:08.936004+0000","last_fullsized":"2024-01-19T05:02:08.936004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2024-01-19T05:02:08.935824+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2024-01-19T05:02:08.935824+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.935824+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:33:46.337375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":3867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'28","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.529942+0000","last_change":"2024-01-19T05:02:02.530004+0000","last_active":"2024-01-19T05:02:02.529942+0000","last_peered":"2024-01-19T05:02:02.529942+0000","last_clean":"2024-01-19T05:02:02.529942+0000","last_became_active":"2024-01-19T04:31:34.846979+0000","last_became_peered":"2024-01-19T04:31:34.846979+0000","last_unstale":"2024-01-19T05:02:02.529942+0000","last_undegraded":"2024-01-19T05:02:02.529942+0000","last_fullsized":"2024-01-19T05:02:02.529942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2024-01-19T05:02:02.529776+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2024-01-19T05:02:02.529776+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.529776+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:53.108539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'10","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.565585+0000","last_change":"2024-01-19T05:01:59.565649+0000","last_active":"2024-01-19T05:01:59.565585+0000","last_peered":"2024-01-19T05:01:59.565585+0000","last_clean":"2024-01-19T05:01:59.565585+0000","last_became_active":"2024-01-19T04:31:31.802193+0000","last_became_peered":"2024-01-19T04:31:31.802193+0000","last_unstale":"2024-01-19T05:01:59.565585+0000","last_undegraded":"2024-01-19T05:01:59.565585+0000","last_fullsized":"2024-01-19T05:01:59.565585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-01-19T05:01:59.565425+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-01-19T05:01:59.565425+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.565425+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:38:50.648511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'86","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:12.775373+0000","last_change":"2024-01-19T05:02:12.775441+0000","last_active":"2024-01-19T05:02:12.775373+0000","last_peered":"2024-01-19T05:02:12.775373+0000","last_clean":"2024-01-19T05:02:12.775373+0000","last_became_active":"2024-01-19T04:31:39.835857+0000","last_became_peered":"2024-01-19T04:31:39.835857+0000","last_unstale":"2024-01-19T05:02:12.775373+0000","last_undegraded":"2024-01-19T05:02:12.775373+0000","last_fullsized":"2024-01-19T05:02:12.775373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'86","last_scrub_stamp":"2024-01-19T05:02:12.775190+0000","last_deep_scrub":"31'86","last_deep_scrub_stamp":"2024-01-19T05:02:12.775190+0000","last_clean_scrub_stamp":"2024-01-19T05:02:12.775190+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:32:31.423230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":13922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'27","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.848137+0000","last_change":"2024-01-19T05:01:59.848192+0000","last_active":"2024-01-19T05:01:59.848137+0000","last_peered":"2024-01-19T05:01:59.848137+0000","last_clean":"2024-01-19T05:01:59.848137+0000","last_became_active":"2024-01-19T04:31:33.150562+0000","last_became_peered":"2024-01-19T04:31:33.150562+0000","last_unstale":"2024-01-19T05:01:59.848137+0000","last_undegraded":"2024-01-19T05:01:59.848137+0000","last_fullsized":"2024-01-19T05:01:59.848137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-01-19T05:01:59.847987+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-01-19T05:01:59.847987+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.847987+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:03.977823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.845137+0000","last_change":"2024-01-19T05:02:02.845248+0000","last_active":"2024-01-19T05:02:02.845137+0000","last_peered":"2024-01-19T05:02:02.845137+0000","last_clean":"2024-01-19T05:02:02.845137+0000","last_became_active":"2024-01-19T04:31:31.833502+0000","last_became_peered":"2024-01-19T04:31:31.833502+0000","last_unstale":"2024-01-19T05:02:02.845137+0000","last_undegraded":"2024-01-19T05:02:02.845137+0000","last_fullsized":"2024-01-19T05:02:02.845137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-01-19T05:02:02.844978+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-01-19T05:02:02.844978+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.844978+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:51.010306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'650","reported_seq":693,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.702819+0000","last_change":"2024-01-19T05:02:02.702977+0000","last_active":"2024-01-19T05:02:02.702819+0000","last_peered":"2024-01-19T05:02:02.702819+0000","last_clean":"2024-01-19T05:02:02.702819+0000","last_became_active":"2024-01-19T04:31:31.838851+0000","last_became_peered":"2024-01-19T04:31:31.838851+0000","last_unstale":"2024-01-19T05:02:02.702819+0000","last_undegraded":"2024-01-19T05:02:02.702819+0000","last_fullsized":"2024-01-19T05:02:02.702819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'650","last_scrub_stamp":"2024-01-19T05:02:02.702612+0000","last_deep_scrub":"31'650","last_deep_scrub_stamp":"2024-01-19T05:02:02.702612+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.702612+0000","objects_scrubbed":4,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:58:44.713223+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'25","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.916316+0000","last_change":"2024-01-19T05:01:59.916356+0000","last_active":"2024-01-19T05:01:59.916316+0000","last_peered":"2024-01-19T05:01:59.916316+0000","last_clean":"2024-01-19T05:01:59.916316+0000","last_became_active":"2024-01-19T04:31:33.039204+0000","last_became_peered":"2024-01-19T04:31:33.039204+0000","last_unstale":"2024-01-19T05:01:59.916316+0000","last_undegraded":"2024-01-19T05:01:59.916316+0000","last_fullsized":"2024-01-19T05:01:59.916316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-01-19T05:01:59.916220+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-01-19T05:01:59.916220+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.916220+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:52.596703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'47","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.438792+0000","last_change":"2024-01-19T05:02:01.438932+0000","last_active":"2024-01-19T05:02:01.438792+0000","last_peered":"2024-01-19T05:02:01.438792+0000","last_clean":"2024-01-19T05:02:01.438792+0000","last_became_active":"2024-01-19T04:31:39.835145+0000","last_became_peered":"2024-01-19T04:31:39.835145+0000","last_unstale":"2024-01-19T05:02:01.438792+0000","last_undegraded":"2024-01-19T05:02:01.438792+0000","last_fullsized":"2024-01-19T05:02:01.438792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-01-19T05:02:01.438531+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-01-19T05:02:01.438531+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.438531+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:48.680642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'586","reported_seq":628,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.845511+0000","last_change":"2024-01-19T05:02:00.845625+0000","last_active":"2024-01-19T05:02:00.845511+0000","last_peered":"2024-01-19T05:02:00.845511+0000","last_clean":"2024-01-19T05:02:00.845511+0000","last_became_active":"2024-01-19T04:31:31.770998+0000","last_became_peered":"2024-01-19T04:31:31.770998+0000","last_unstale":"2024-01-19T05:02:00.845511+0000","last_undegraded":"2024-01-19T05:02:00.845511+0000","last_fullsized":"2024-01-19T05:02:00.845511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'586","last_scrub_stamp":"2024-01-19T05:02:00.845345+0000","last_deep_scrub":"31'586","last_deep_scrub_stamp":"2024-01-19T05:02:00.845345+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.845345+0000","objects_scrubbed":3,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:03:48.286590+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'23","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.247723+0000","last_change":"2024-01-19T05:01:58.247779+0000","last_active":"2024-01-19T05:01:58.247723+0000","last_peered":"2024-01-19T05:01:58.247723+0000","last_clean":"2024-01-19T05:01:58.247723+0000","last_became_active":"2024-01-19T04:31:33.039538+0000","last_became_peered":"2024-01-19T04:31:33.039538+0000","last_unstale":"2024-01-19T05:01:58.247723+0000","last_undegraded":"2024-01-19T05:01:58.247723+0000","last_fullsized":"2024-01-19T05:01:58.247723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:01:58.247560+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:01:58.247560+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.247560+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:12:27.154914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'107","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:09.877682+0000","last_change":"2024-01-19T05:02:09.877750+0000","last_active":"2024-01-19T05:02:09.877682+0000","last_peered":"2024-01-19T05:02:09.877682+0000","last_clean":"2024-01-19T05:02:09.877682+0000","last_became_active":"2024-01-19T04:31:39.822712+0000","last_became_peered":"2024-01-19T04:31:39.822712+0000","last_unstale":"2024-01-19T05:02:09.877682+0000","last_undegraded":"2024-01-19T05:02:09.877682+0000","last_fullsized":"2024-01-19T05:02:09.877682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'107","last_scrub_stamp":"2024-01-19T05:02:09.877512+0000","last_deep_scrub":"31'107","last_deep_scrub_stamp":"2024-01-19T05:02:09.877512+0000","last_clean_scrub_stamp":"2024-01-19T05:02:09.877512+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:54:55.678261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.681402+0000","last_change":"2024-01-19T05:02:04.681462+0000","last_active":"2024-01-19T05:02:04.681402+0000","last_peered":"2024-01-19T05:02:04.681402+0000","last_clean":"2024-01-19T05:02:04.681402+0000","last_became_active":"2024-01-19T04:31:33.214743+0000","last_became_peered":"2024-01-19T04:31:33.214743+0000","last_unstale":"2024-01-19T05:02:04.681402+0000","last_undegraded":"2024-01-19T05:02:04.681402+0000","last_fullsized":"2024-01-19T05:02:04.681402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-01-19T05:02:04.681238+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-01-19T05:02:04.681238+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.681238+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:13.367046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:59.381396+0000","last_change":"2024-01-19T05:01:59.381456+0000","last_active":"2024-01-19T05:01:59.381396+0000","last_peered":"2024-01-19T05:01:59.381396+0000","last_clean":"2024-01-19T05:01:59.381396+0000","last_became_active":"2024-01-19T04:31:34.775291+0000","last_became_peered":"2024-01-19T04:31:34.775291+0000","last_unstale":"2024-01-19T05:01:59.381396+0000","last_undegraded":"2024-01-19T05:01:59.381396+0000","last_fullsized":"2024-01-19T05:01:59.381396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-01-19T05:01:59.381234+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-01-19T05:01:59.381234+0000","last_clean_scrub_stamp":"2024-01-19T05:01:59.381234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:18.306237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.436281+0000","last_change":"2024-01-19T05:02:05.436344+0000","last_active":"2024-01-19T05:02:05.436281+0000","last_peered":"2024-01-19T05:02:05.436281+0000","last_clean":"2024-01-19T05:02:05.436281+0000","last_became_active":"2024-01-19T04:31:34.735530+0000","last_became_peered":"2024-01-19T04:31:34.735530+0000","last_unstale":"2024-01-19T05:02:05.436281+0000","last_undegraded":"2024-01-19T05:02:05.436281+0000","last_fullsized":"2024-01-19T05:02:05.436281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2024-01-19T05:02:05.436114+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2024-01-19T05:02:05.436114+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.436114+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:53.601442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'24","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:01.923664+0000","last_change":"2024-01-19T05:02:01.923721+0000","last_active":"2024-01-19T05:02:01.923664+0000","last_peered":"2024-01-19T05:02:01.923664+0000","last_clean":"2024-01-19T05:02:01.923664+0000","last_became_active":"2024-01-19T04:31:33.152659+0000","last_became_peered":"2024-01-19T04:31:33.152659+0000","last_unstale":"2024-01-19T05:02:01.923664+0000","last_undegraded":"2024-01-19T05:02:01.923664+0000","last_fullsized":"2024-01-19T05:02:01.923664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:01.923506+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:01.923506+0000","last_clean_scrub_stamp":"2024-01-19T05:02:01.923506+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:31:40.415647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'17","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.869602+0000","last_change":"2024-01-19T05:02:04.869664+0000","last_active":"2024-01-19T05:02:04.869602+0000","last_peered":"2024-01-19T05:02:04.869602+0000","last_clean":"2024-01-19T05:02:04.869602+0000","last_became_active":"2024-01-19T04:31:33.148971+0000","last_became_peered":"2024-01-19T04:31:33.148971+0000","last_unstale":"2024-01-19T05:02:04.869602+0000","last_undegraded":"2024-01-19T05:02:04.869602+0000","last_fullsized":"2024-01-19T05:02:04.869602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2024-01-19T05:02:04.869444+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2024-01-19T05:02:04.869444+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.869444+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:32.713438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.511127+0000","last_change":"2024-01-19T05:02:03.511251+0000","last_active":"2024-01-19T05:02:03.511127+0000","last_peered":"2024-01-19T05:02:03.511127+0000","last_clean":"2024-01-19T05:02:03.511127+0000","last_became_active":"2024-01-19T04:31:34.847072+0000","last_became_peered":"2024-01-19T04:31:34.847072+0000","last_unstale":"2024-01-19T05:02:03.511127+0000","last_undegraded":"2024-01-19T05:02:03.511127+0000","last_fullsized":"2024-01-19T05:02:03.511127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-01-19T05:02:03.510897+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-01-19T05:02:03.510897+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.510897+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:51.676225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'34","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.649367+0000","last_change":"2024-01-19T05:02:05.649487+0000","last_active":"2024-01-19T05:02:05.649367+0000","last_peered":"2024-01-19T05:02:05.649367+0000","last_clean":"2024-01-19T05:02:05.649367+0000","last_became_active":"2024-01-19T04:31:33.216787+0000","last_became_peered":"2024-01-19T04:31:33.216787+0000","last_unstale":"2024-01-19T05:02:05.649367+0000","last_undegraded":"2024-01-19T05:02:05.649367+0000","last_fullsized":"2024-01-19T05:02:05.649367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2024-01-19T05:02:05.649122+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2024-01-19T05:02:05.649122+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.649122+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:58.263523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'18","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.890148+0000","last_change":"2024-01-19T05:02:07.890207+0000","last_active":"2024-01-19T05:02:07.890148+0000","last_peered":"2024-01-19T05:02:07.890148+0000","last_clean":"2024-01-19T05:02:07.890148+0000","last_became_active":"2024-01-19T04:31:33.150781+0000","last_became_peered":"2024-01-19T04:31:33.150781+0000","last_unstale":"2024-01-19T05:02:07.890148+0000","last_undegraded":"2024-01-19T05:02:07.890148+0000","last_fullsized":"2024-01-19T05:02:07.890148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:02:07.889985+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:02:07.889985+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.889985+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:57:05.785722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'20","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.499229+0000","last_change":"2024-01-19T05:02:03.499229+0000","last_active":"2024-01-19T05:02:03.499229+0000","last_peered":"2024-01-19T05:02:03.499229+0000","last_clean":"2024-01-19T05:02:03.499229+0000","last_became_active":"2024-01-19T04:31:34.732766+0000","last_became_peered":"2024-01-19T04:31:34.732766+0000","last_unstale":"2024-01-19T05:02:03.499229+0000","last_undegraded":"2024-01-19T05:02:03.499229+0000","last_fullsized":"2024-01-19T05:02:03.499229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-01-19T05:02:03.498923+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-01-19T05:02:03.498923+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.498923+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:03:50.940167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'30","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.893009+0000","last_change":"2024-01-19T05:02:03.893120+0000","last_active":"2024-01-19T05:02:03.893009+0000","last_peered":"2024-01-19T05:02:03.893009+0000","last_clean":"2024-01-19T05:02:03.893009+0000","last_became_active":"2024-01-19T04:31:33.147820+0000","last_became_peered":"2024-01-19T04:31:33.147820+0000","last_unstale":"2024-01-19T05:02:03.893009+0000","last_undegraded":"2024-01-19T05:02:03.893009+0000","last_fullsized":"2024-01-19T05:02:03.893009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-01-19T05:02:03.892774+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-01-19T05:02:03.892774+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.892774+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:47:18.508321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'27","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:57.563458+0000","last_change":"2024-01-19T05:01:57.563517+0000","last_active":"2024-01-19T05:01:57.563458+0000","last_peered":"2024-01-19T05:01:57.563458+0000","last_clean":"2024-01-19T05:01:57.563458+0000","last_became_active":"2024-01-19T04:31:34.743131+0000","last_became_peered":"2024-01-19T04:31:34.743131+0000","last_unstale":"2024-01-19T05:01:57.563458+0000","last_undegraded":"2024-01-19T05:01:57.563458+0000","last_fullsized":"2024-01-19T05:01:57.563458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-01-19T05:01:57.563292+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-01-19T05:01:57.563292+0000","last_clean_scrub_stamp":"2024-01-19T05:01:57.563292+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:56:00.173208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'31","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:55.942116+0000","last_change":"2024-01-19T05:01:55.942155+0000","last_active":"2024-01-19T05:01:55.942116+0000","last_peered":"2024-01-19T05:01:55.942116+0000","last_clean":"2024-01-19T05:01:55.942116+0000","last_became_active":"2024-01-19T04:31:32.993195+0000","last_became_peered":"2024-01-19T04:31:32.993195+0000","last_unstale":"2024-01-19T05:01:55.942116+0000","last_undegraded":"2024-01-19T05:01:55.942116+0000","last_fullsized":"2024-01-19T05:01:55.942116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-01-19T05:01:55.942018+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-01-19T05:01:55.942018+0000","last_clean_scrub_stamp":"2024-01-19T05:01:55.942018+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:38:26.247015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'25","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.673003+0000","last_change":"2024-01-19T05:02:07.673109+0000","last_active":"2024-01-19T05:02:07.673003+0000","last_peered":"2024-01-19T05:02:07.673003+0000","last_clean":"2024-01-19T05:02:07.673003+0000","last_became_active":"2024-01-19T04:31:33.219289+0000","last_became_peered":"2024-01-19T04:31:33.219289+0000","last_unstale":"2024-01-19T05:02:07.673003+0000","last_undegraded":"2024-01-19T05:02:07.673003+0000","last_fullsized":"2024-01-19T05:02:07.673003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-01-19T05:02:07.672826+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-01-19T05:02:07.672826+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.672826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:58.251589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'23","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:11.753199+0000","last_change":"2024-01-19T05:02:11.753244+0000","last_active":"2024-01-19T05:02:11.753199+0000","last_peered":"2024-01-19T05:02:11.753199+0000","last_clean":"2024-01-19T05:02:11.753199+0000","last_became_active":"2024-01-19T04:31:33.072134+0000","last_became_peered":"2024-01-19T04:31:33.072134+0000","last_unstale":"2024-01-19T05:02:11.753199+0000","last_undegraded":"2024-01-19T05:02:11.753199+0000","last_fullsized":"2024-01-19T05:02:11.753199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:11.753069+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:11.753069+0000","last_clean_scrub_stamp":"2024-01-19T05:02:11.753069+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:39.246274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'31","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:00.397154+0000","last_change":"2024-01-19T05:02:00.397264+0000","last_active":"2024-01-19T05:02:00.397154+0000","last_peered":"2024-01-19T05:02:00.397154+0000","last_clean":"2024-01-19T05:02:00.397154+0000","last_became_active":"2024-01-19T04:31:35.305654+0000","last_became_peered":"2024-01-19T04:31:35.305654+0000","last_unstale":"2024-01-19T05:02:00.397154+0000","last_undegraded":"2024-01-19T05:02:00.397154+0000","last_fullsized":"2024-01-19T05:02:00.397154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-01-19T05:02:00.396902+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-01-19T05:02:00.396902+0000","last_clean_scrub_stamp":"2024-01-19T05:02:00.396902+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:23.295580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'27","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:03.426144+0000","last_change":"2024-01-19T05:02:03.426204+0000","last_active":"2024-01-19T05:02:03.426144+0000","last_peered":"2024-01-19T05:02:03.426144+0000","last_clean":"2024-01-19T05:02:03.426144+0000","last_became_active":"2024-01-19T04:32:37.019820+0000","last_became_peered":"2024-01-19T04:32:37.019820+0000","last_unstale":"2024-01-19T05:02:03.426144+0000","last_undegraded":"2024-01-19T05:02:03.426144+0000","last_fullsized":"2024-01-19T05:02:03.426144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-01-19T05:02:03.425978+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-01-19T05:02:03.425978+0000","last_clean_scrub_stamp":"2024-01-19T05:02:03.425978+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:08.862238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'30","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.439821+0000","last_change":"2024-01-19T05:02:08.439881+0000","last_active":"2024-01-19T05:02:08.439821+0000","last_peered":"2024-01-19T05:02:08.439821+0000","last_clean":"2024-01-19T05:02:08.439821+0000","last_became_active":"2024-01-19T04:31:35.042544+0000","last_became_peered":"2024-01-19T04:31:35.042544+0000","last_unstale":"2024-01-19T05:02:08.439821+0000","last_undegraded":"2024-01-19T05:02:08.439821+0000","last_fullsized":"2024-01-19T05:02:08.439821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2024-01-19T05:02:08.439640+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2024-01-19T05:02:08.439640+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.439640+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:38.668881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'23","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:05.535705+0000","last_change":"2024-01-19T05:02:05.535768+0000","last_active":"2024-01-19T05:02:05.535705+0000","last_peered":"2024-01-19T05:02:05.535705+0000","last_clean":"2024-01-19T05:02:05.535705+0000","last_became_active":"2024-01-19T04:31:35.153816+0000","last_became_peered":"2024-01-19T04:31:35.153816+0000","last_unstale":"2024-01-19T05:02:05.535705+0000","last_undegraded":"2024-01-19T05:02:05.535705+0000","last_fullsized":"2024-01-19T05:02:05.535705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-01-19T05:02:05.535540+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-01-19T05:02:05.535540+0000","last_clean_scrub_stamp":"2024-01-19T05:02:05.535540+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:33.379533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'25","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:57.958345+0000","last_change":"2024-01-19T05:01:57.958345+0000","last_active":"2024-01-19T05:01:57.958345+0000","last_peered":"2024-01-19T05:01:57.958345+0000","last_clean":"2024-01-19T05:01:57.958345+0000","last_became_active":"2024-01-19T04:31:33.033994+0000","last_became_peered":"2024-01-19T04:31:33.033994+0000","last_unstale":"2024-01-19T05:01:57.958345+0000","last_undegraded":"2024-01-19T05:01:57.958345+0000","last_fullsized":"2024-01-19T05:01:57.958345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-01-19T05:01:57.958120+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-01-19T05:01:57.958120+0000","last_clean_scrub_stamp":"2024-01-19T05:01:57.958120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:19:41.868986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'29","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:56.783917+0000","last_change":"2024-01-19T05:01:56.783973+0000","last_active":"2024-01-19T05:01:56.783917+0000","last_peered":"2024-01-19T05:01:56.783917+0000","last_clean":"2024-01-19T05:01:56.783917+0000","last_became_active":"2024-01-19T04:31:33.216698+0000","last_became_peered":"2024-01-19T04:31:33.216698+0000","last_unstale":"2024-01-19T05:01:56.783917+0000","last_undegraded":"2024-01-19T05:01:56.783917+0000","last_fullsized":"2024-01-19T05:01:56.783917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2024-01-19T05:01:56.783745+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2024-01-19T05:01:56.783745+0000","last_clean_scrub_stamp":"2024-01-19T05:01:56.783745+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:05.662423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'18","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:02.238797+0000","last_change":"2024-01-19T05:02:02.238908+0000","last_active":"2024-01-19T05:02:02.238797+0000","last_peered":"2024-01-19T05:02:02.238797+0000","last_clean":"2024-01-19T05:02:02.238797+0000","last_became_active":"2024-01-19T04:31:33.218381+0000","last_became_peered":"2024-01-19T04:31:33.218381+0000","last_unstale":"2024-01-19T05:02:02.238797+0000","last_undegraded":"2024-01-19T05:02:02.238797+0000","last_fullsized":"2024-01-19T05:02:02.238797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:02:02.238586+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:02:02.238586+0000","last_clean_scrub_stamp":"2024-01-19T05:02:02.238586+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:36:23.858580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'24","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:09.764383+0000","last_change":"2024-01-19T05:02:09.764494+0000","last_active":"2024-01-19T05:02:09.764383+0000","last_peered":"2024-01-19T05:02:09.764383+0000","last_clean":"2024-01-19T05:02:09.764383+0000","last_became_active":"2024-01-19T04:31:33.251399+0000","last_became_peered":"2024-01-19T04:31:33.251399+0000","last_unstale":"2024-01-19T05:02:09.764383+0000","last_undegraded":"2024-01-19T05:02:09.764383+0000","last_fullsized":"2024-01-19T05:02:09.764383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:09.764192+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:09.764192+0000","last_clean_scrub_stamp":"2024-01-19T05:02:09.764192+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:47:24.379739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'33","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:08.717122+0000","last_change":"2024-01-19T05:02:08.717187+0000","last_active":"2024-01-19T05:02:08.717122+0000","last_peered":"2024-01-19T05:02:08.717122+0000","last_clean":"2024-01-19T05:02:08.717122+0000","last_became_active":"2024-01-19T04:31:33.248079+0000","last_became_peered":"2024-01-19T04:31:33.248079+0000","last_unstale":"2024-01-19T05:02:08.717122+0000","last_undegraded":"2024-01-19T05:02:08.717122+0000","last_fullsized":"2024-01-19T05:02:08.717122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2024-01-19T05:02:08.716950+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2024-01-19T05:02:08.716950+0000","last_clean_scrub_stamp":"2024-01-19T05:02:08.716950+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:56.882278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'28","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:15.739532+0000","last_change":"2024-01-19T05:02:15.739588+0000","last_active":"2024-01-19T05:02:15.739532+0000","last_peered":"2024-01-19T05:02:15.739532+0000","last_clean":"2024-01-19T05:02:15.739532+0000","last_became_active":"2024-01-19T04:31:33.252904+0000","last_became_peered":"2024-01-19T04:31:33.252904+0000","last_unstale":"2024-01-19T05:02:15.739532+0000","last_undegraded":"2024-01-19T05:02:15.739532+0000","last_fullsized":"2024-01-19T05:02:15.739532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2024-01-19T05:02:15.739369+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2024-01-19T05:02:15.739369+0000","last_clean_scrub_stamp":"2024-01-19T05:02:15.739369+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:08:07.047387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'19","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:58.837303+0000","last_change":"2024-01-19T05:01:58.837326+0000","last_active":"2024-01-19T05:01:58.837303+0000","last_peered":"2024-01-19T05:01:58.837303+0000","last_clean":"2024-01-19T05:01:58.837303+0000","last_became_active":"2024-01-19T04:31:33.248772+0000","last_became_peered":"2024-01-19T04:31:33.248772+0000","last_unstale":"2024-01-19T05:01:58.837303+0000","last_undegraded":"2024-01-19T05:01:58.837303+0000","last_fullsized":"2024-01-19T05:01:58.837303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'19","last_scrub_stamp":"2024-01-19T05:01:58.837232+0000","last_deep_scrub":"31'19","last_deep_scrub_stamp":"2024-01-19T05:01:58.837232+0000","last_clean_scrub_stamp":"2024-01-19T05:01:58.837232+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:51:36.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'21","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.765768+0000","last_change":"2024-01-19T05:02:07.765880+0000","last_active":"2024-01-19T05:02:07.765768+0000","last_peered":"2024-01-19T05:02:07.765768+0000","last_clean":"2024-01-19T05:02:07.765768+0000","last_became_active":"2024-01-19T04:31:32.991828+0000","last_became_peered":"2024-01-19T04:31:32.991828+0000","last_unstale":"2024-01-19T05:02:07.765768+0000","last_undegraded":"2024-01-19T05:02:07.765768+0000","last_fullsized":"2024-01-19T05:02:07.765768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-01-19T05:02:07.765586+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-01-19T05:02:07.765586+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.765586+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:35:46.757948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'28","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:07.425568+0000","last_change":"2024-01-19T05:02:07.425678+0000","last_active":"2024-01-19T05:02:07.425568+0000","last_peered":"2024-01-19T05:02:07.425568+0000","last_clean":"2024-01-19T05:02:07.425568+0000","last_became_active":"2024-01-19T04:31:35.042427+0000","last_became_peered":"2024-01-19T04:31:35.042427+0000","last_unstale":"2024-01-19T05:02:07.425568+0000","last_undegraded":"2024-01-19T05:02:07.425568+0000","last_fullsized":"2024-01-19T05:02:07.425568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2024-01-19T05:02:07.425390+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2024-01-19T05:02:07.425390+0000","last_clean_scrub_stamp":"2024-01-19T05:02:07.425390+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:35.269383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"31'24","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:11.534856+0000","last_change":"2024-01-19T05:02:11.534940+0000","last_active":"2024-01-19T05:02:11.534856+0000","last_peered":"2024-01-19T05:02:11.534856+0000","last_clean":"2024-01-19T05:02:11.534856+0000","last_became_active":"2024-01-19T04:32:36.986250+0000","last_became_peered":"2024-01-19T04:32:36.986250+0000","last_unstale":"2024-01-19T05:02:11.534856+0000","last_undegraded":"2024-01-19T05:02:11.534856+0000","last_fullsized":"2024-01-19T05:02:11.534856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:11.534679+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:11.534679+0000","last_clean_scrub_stamp":"2024-01-19T05:02:11.534679+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:11:37.604755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"31'18","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.478098+0000","last_change":"2024-01-19T05:02:04.478160+0000","last_active":"2024-01-19T05:02:04.478098+0000","last_peered":"2024-01-19T05:02:04.478098+0000","last_clean":"2024-01-19T05:02:04.478098+0000","last_became_active":"2024-01-19T04:31:34.732704+0000","last_became_peered":"2024-01-19T04:31:34.732704+0000","last_unstale":"2024-01-19T05:02:04.478098+0000","last_undegraded":"2024-01-19T05:02:04.478098+0000","last_fullsized":"2024-01-19T05:02:04.478098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-01-19T05:02:04.477932+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-01-19T05:02:04.477932+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.477932+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:55.056695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'26","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:01:52.899853+0000","last_change":"2024-01-19T05:01:52.899911+0000","last_active":"2024-01-19T05:01:52.899853+0000","last_peered":"2024-01-19T05:01:52.899853+0000","last_clean":"2024-01-19T05:01:52.899853+0000","last_became_active":"2024-01-19T04:31:33.072426+0000","last_became_peered":"2024-01-19T04:31:33.072426+0000","last_unstale":"2024-01-19T05:01:52.899853+0000","last_undegraded":"2024-01-19T05:01:52.899853+0000","last_fullsized":"2024-01-19T05:01:52.899853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2024-01-19T05:01:52.899695+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2024-01-19T05:01:52.899695+0000","last_clean_scrub_stamp":"2024-01-19T05:01:52.899695+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:38.851011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'19","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:04.502415+0000","last_change":"2024-01-19T05:02:04.502479+0000","last_active":"2024-01-19T05:02:04.502415+0000","last_peered":"2024-01-19T05:02:04.502415+0000","last_clean":"2024-01-19T05:02:04.502415+0000","last_became_active":"2024-01-19T04:31:35.042682+0000","last_became_peered":"2024-01-19T04:31:35.042682+0000","last_unstale":"2024-01-19T05:02:04.502415+0000","last_undegraded":"2024-01-19T05:02:04.502415+0000","last_fullsized":"2024-01-19T05:02:04.502415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'19","last_scrub_stamp":"2024-01-19T05:02:04.502231+0000","last_deep_scrub":"31'19","last_deep_scrub_stamp":"2024-01-19T05:02:04.502231+0000","last_clean_scrub_stamp":"2024-01-19T05:02:04.502231+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:47:19.117778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'24","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:02:13.760359+0000","last_change":"2024-01-19T05:02:13.760417+0000","last_active":"2024-01-19T05:02:13.760359+0000","last_peered":"2024-01-19T05:02:13.760359+0000","last_clean":"2024-01-19T05:02:13.760359+0000","last_became_active":"2024-01-19T04:31:33.216438+0000","last_became_peered":"2024-01-19T04:31:33.216438+0000","last_unstale":"2024-01-19T05:02:13.760359+0000","last_undegraded":"2024-01-19T05:02:13.760359+0000","last_fullsized":"2024-01-19T05:02:13.760359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-01-19T05:02:13.760185+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-01-19T05:02:13.760185+0000","last_clean_scrub_stamp":"2024-01-19T05:02:13.760185+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:33:51.161736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2422,"num_write_kb":254160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2601,"ondisk_log_size":2601,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1580,"ondisk_log_size":1580,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24103801,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":561,"num_read_kb":585,"num_write":5649,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48455680,"data_stored":48207602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5259,"ondisk_log_size":5259,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477119,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":495616,"data_stored":270316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.26100000000000001},"max":{"1min":1.2509999999999999,"5min":1.3160000000000001,"15min":2.2389999999999999},"last":0.626},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.76200000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.29699999999999999},"max":{"1min":1.4099999999999999,"5min":1.4339999999999999,"15min":1.6739999999999999},"last":0.86499999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.83399999999999996,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.41199999999999998,"15min":0.309},"max":{"1min":1.264,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.875,"15min":0.81899999999999995},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.32200000000000001},"max":{"1min":1.202,"5min":1.754,"15min":1.754},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.77300000000000002},"min":{"1min":0.45400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2709999999999999,"5min":2.52,"15min":2.52},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93799999999999994,"15min":0.90500000000000003},"min":{"1min":0.437,"5min":0.373,"15min":0.31900000000000001},"max":{"1min":1.321,"5min":1.5,"15min":2.0670000000000002},"last":0.90200000000000002}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0740000000000001,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":1.667,"15min":1.9590000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0820000000000001,"15min":1.0509999999999999},"min":{"1min":0.83199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.49,"5min":1.867,"15min":1.867},"last":1.321}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1040000000000001,"15min":1.081},"min":{"1min":0.73399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.452,"5min":1.954,"15min":1.954},"last":1.024},{"interface":"front","average":{"1min":1.018,"5min":1.0800000000000001,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.66500000000000004,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":2.625,"15min":2.625},"last":1.415}]},{"osd":6,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.0880000000000001,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1599999999999999,"15min":1.1439999999999999},"min":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.57799999999999996},"max":{"1min":1.736,"5min":1.736,"15min":2.129},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.151},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":1.913,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1890000000000001,"15min":1.119},"min":{"1min":0.84899999999999998,"5min":0.74399999999999999,"15min":0.60499999999999998},"max":{"1min":1.444,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.341}]}]},{"osd":1,"up_from":16,"seq":68719477120,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":140672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.51800000000000002,"5min":0.40200000000000002,"15min":0.35099999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.4490000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78800000000000003,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.675},"last":1.1060000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.29399999999999998},"max":{"1min":1.22,"5min":1.244,"15min":1.4930000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.86199999999999999,"15min":0.84499999999999997},"min":{"1min":0.59299999999999997,"5min":0.40000000000000002,"15min":0.29499999999999998},"max":{"1min":1.466,"5min":1.468,"15min":1.486},"last":1.012}]},{"osd":3,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.873},"min":{"1min":0.68400000000000005,"5min":0.443,"15min":0.31900000000000001},"max":{"1min":1.1639999999999999,"5min":1.3140000000000001,"15min":1.6200000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.875,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.36299999999999999},"max":{"1min":1.5149999999999999,"5min":1.605,"15min":1.605},"last":0.81499999999999995}]},{"osd":4,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.65700000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3400000000000001,"5min":1.47,"15min":1.7689999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1160000000000001,"15min":1.1020000000000001},"min":{"1min":0.81200000000000006,"5min":0.69399999999999995,"15min":0.63300000000000001},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.9590000000000001},"last":1.327}]},{"osd":5,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0920000000000001},"min":{"1min":0.871,"5min":0.63300000000000001,"15min":0.60399999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.83699999999999997,"5min":0.56299999999999994,"15min":0.45500000000000002},"max":{"1min":1.5329999999999999,"5min":1.5469999999999999,"15min":1.72},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1499999999999999,"15min":1.1599999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.133,"15min":1.1359999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0030000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.1850000000000001},"min":{"1min":0.94999999999999996,"5min":0.76700000000000002,"15min":0.61299999999999999},"max":{"1min":1.744,"5min":1.9139999999999999,"15min":2.0150000000000001},"last":1.454},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.89200000000000002,"5min":0.73599999999999999,"15min":0.69099999999999995},"max":{"1min":1.921,"5min":1.921,"15min":2.2650000000000001},"last":1.5229999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509823,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":8744960,"data_stored":8529791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.84299999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.2909999999999999,"15min":1.3500000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86699999999999999,"15min":0.877},"min":{"1min":0.57599999999999996,"5min":0.53100000000000003,"15min":0.42699999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.712},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.216,"5min":1.4359999999999999,"15min":1.5269999999999999},"last":1.173},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94099999999999995,"15min":0.92400000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.45200000000000001},"max":{"1min":1.2569999999999999,"5min":1.391,"15min":1.3999999999999999},"last":1.145}]},{"osd":2,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92500000000000004,"15min":0.91000000000000003},"min":{"1min":0.67900000000000005,"5min":0.60499999999999998,"15min":0.46700000000000003},"max":{"1min":1.4139999999999999,"5min":1.462,"15min":1.5740000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.022,"15min":0.96999999999999997},"min":{"1min":0.76200000000000001,"5min":0.66800000000000004,"15min":0.55600000000000005},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97199999999999998,"15min":0.95299999999999996},"min":{"1min":0.69899999999999995,"5min":0.625,"15min":0.46100000000000002},"max":{"1min":1.3640000000000001,"5min":1.3979999999999999,"15min":1.4850000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.119,"5min":1.079,"15min":1.0469999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.47899999999999998},"max":{"1min":1.3979999999999999,"5min":1.552,"15min":1.6180000000000001},"last":1.042}]},{"osd":4,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94399999999999995},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.58899999999999997},"max":{"1min":1.167,"5min":1.3360000000000001,"15min":1.8169999999999999},"last":1.075},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0760000000000001,"15min":1.0740000000000001},"min":{"1min":0.84199999999999997,"5min":0.59799999999999998,"15min":0.46800000000000003},"max":{"1min":1.4319999999999999,"5min":1.486,"15min":1.7589999999999999},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0189999999999999,"15min":1.0129999999999999},"min":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.45700000000000002},"max":{"1min":1.3540000000000001,"5min":1.444,"15min":1.657},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.119,"15min":1.135},"min":{"1min":0.73799999999999999,"5min":0.66100000000000003,"15min":0.61699999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.698},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jan 19 05:01:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.163,"15min":1.155},"min":{"1min":0.89300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1499999999999999,"15min":1.143},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3360000000000001,"5min":1.512,"15min":1.7769999999999999},"last":1.002}]}]},{"osd":5,"up_from":15,"seq":64424509823,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":143653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.84799999999999998,"15min":0.81499999999999995},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.433},"max":{"1min":3.2200000000000002,"5min":3.2200000000000002,"15min":3.2200000000000002},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95699999999999996,"15min":0.92400000000000004},"min":{"1min":0.63600000000000001,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.91200000000000003},"min":{"1min":0.69699999999999995,"5min":0.55300000000000005,"15min":0.40300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0289999999999999,"15min":0.98699999999999999},"min":{"1min":0.61699999999999999,"5min":0.56799999999999995,"15min":0.5},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.97199999999999998,"15min":0.94499999999999995},"min":{"1min":0.67100000000000004,"5min":0.60999999999999999,"15min":0.51100000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0609999999999999,"15min":1.0600000000000001},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.47399999999999998},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0669999999999999,"15min":1.0249999999999999},"min":{"1min":0.68899999999999995,"5min":0.67500000000000004,"15min":0.58899999999999997},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.90800000000000003,"15min":0.89400000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47899999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.173,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.65000000000000002,"15min":0.51900000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.101}]},{"osd":6,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.028,"15min":1.0449999999999999},"min":{"1min":0.68600000000000005,"5min":0.58299999999999996,"15min":0.44900000000000001},"max":{"1min":1.3839999999999999,"5min":1.466,"15min":1.468},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.008,"15min":0.996},"min":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.33200000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:01:41 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1839999999999999,"15min":1.171},"min":{"1min":1.016,"5min":0.79700000000000004,"15min":0.42399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.80800000000000005,"5min":0.64500000000000002,"15min":0.57999999999999996},"max":{"1min":1.5389999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.147}]}]},{"osd":4,"up_from":15,"seq":64424509822,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":8744960,"data_stored":8529659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88100000000000001,"15min":0.88500000000000001},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1990000000000001,"5min":1.3109999999999999,"15min":2.04},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89300000000000002},"min":{"1min":0.64700000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.198}]},{"osd":1,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3089999999999999,"5min":1.4399999999999999,"15min":2.1970000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.51500000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.6309999999999998},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.51300000000000001},"max":{"1min":1.3879999999999999,"5min":1.6279999999999999,"15min":2.7810000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64000000000000001,"5min":0.55100000000000005,"15min":0.504},"max":{"1min":1.5640000000000001,"5min":1.7,"15min":1.7},"last":1.4770000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.008,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.68300000000000005,"15min":0.55600000000000005},"max":{"1min":1.595,"5min":1.595,"15min":2.4820000000000002},"last":1.127},{"interface":"front","average":{"1min":1.123,"5min":1.069,"15min":1.083},"min":{"1min":0.84399999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.339,"5min":1.5369999999999999,"15min":2.4399999999999999},"last":1.085}]},{"osd":5,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.46000000000000002},"max":{"1min":1.484,"5min":1.5149999999999999,"15min":1.9119999999999999},"last":0.998},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.034,"15min":1.054},"min":{"1min":0.70799999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":2.7160000000000002},"last":1.325}]},{"osd":6,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.115,"15min":1.135},"min":{"1min":0.73399999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.474,"5min":1.502,"15min":2.3650000000000002},"last":1.423},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.095,"15min":1.1180000000000001},"min":{"1min":0.85499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.7549999999999999},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:01:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1080000000000001,"15min":1.131},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.601,"5min":1.601,"15min":3.1720000000000002},"last":1.256},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2,"15min":1.24},"min":{"1min":0.94999999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.49,"5min":1.718,"15min":2.8999999999999999},"last":1.29}]}]},{"osd":3,"up_from":15,"seq":64424509823,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":11600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":11878400,"data_stored":11653269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.33600000000000002},"max":{"1min":1.0009999999999999,"5min":1.47,"15min":1.47},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.71699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.30599999999999999},"max":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.3109999999999999},"last":0.83899999999999997}]},{"osd":1,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.33400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3069999999999999,"15min":1.4339999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85199999999999998,"15min":0.80900000000000005},"min":{"1min":0.57799999999999996,"5min":0.42499999999999999,"15min":0.36199999999999999},"max":{"1min":1.153,"5min":1.444,"15min":1.444},"last":1.423}]},{"osd":2,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.47599999999999998,"15min":0.376},"max":{"1min":1.397,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.88500000000000001},"min":{"1min":0.51300000000000001,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4870000000000001,"5min":1.5369999999999999,"15min":1.5680000000000001},"last":1.3109999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.5049999999999999,"15min":1.5580000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.071,"5min":1.103,"15min":1.075},"min":{"1min":0.78100000000000003,"5min":0.65100000000000002,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.2629999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.0920000000000001},"min":{"1min":0.68700000000000006,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.728,"15min":1.728},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.0580000000000001},"min":{"1min":0.74399999999999999,"5min":0.621,"15min":0.60299999999999998},"max":{"1min":1.6459999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.052}]},{"osd":6,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0940000000000001,"15min":1.0649999999999999},"min":{"1min":0.81200000000000006,"5min":0.68400000000000005,"15min":0.56200000000000006},"max":{"1min":1.3939999999999999,"5min":1.569,"15min":1.734},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.165},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1299999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.161,"15min":1.1180000000000001},"min":{"1min":0.874,"5min":0.69799999999999995,"15min":0.60999999999999999},"max":{"1min":1.5700000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.212},{"interface":"front","average":{"1min":1.129,"5min":1.163,"15min":1.1240000000000001},"min":{"1min":0.93200000000000005,"5min":0.78300000000000003,"15min":0.69999999999999996},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.8340000000000001},"last":1.1830000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542526,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48564,"kb_used_data":13228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323276,"statfs":{"total":96636764160,"available":96587034624,"internally_reserved":0,"allocated":13545472,"data_stored":13315101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.88200000000000001,"15min":0.83799999999999997},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.372},"max":{"1min":1.304,"5min":1.577,"15min":1.577},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.56100000000000005,"5min":0.51100000000000001,"15min":0.47699999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.4019999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.753,"5min":0.55900000000000005,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.94899999999999995,"15min":0.91800000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.48399999999999999},"max":{"1min":1.2430000000000001,"5min":1.3560000000000001,"15min":1.7549999999999999},"last":1.165}]},{"osd":2,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.97099999999999997,"15min":0.96399999999999997},"min":{"1min":0.75900000000000001,"5min":0.60299999999999998,"15min":0.504},"max":{"1min":1.2689999999999999,"5min":1.5349999999999999,"15min":1.5509999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.999,"15min":0.995},"min":{"1min":0.67500000000000004,"5min":0.58699999999999997,"15min":0.55000000000000004},"max":{"1min":1.2789999999999999,"5min":1.4390000000000001,"15min":1.6319999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.026,"15min":1.0129999999999999},"min":{"1min":0.70699999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2110000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.117},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96599999999999997,"15min":0.97799999999999998},"min":{"1min":0.64300000000000002,"5min":0.51100000000000001,"15min":0.46500000000000002},"max":{"1min":1.3540000000000001,"5min":1.758,"15min":1.758},"last":0.875}]},{"osd":4,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98799999999999999,"15min":0.97899999999999998},"min":{"1min":0.68899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2829999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.02,"15min":1.0580000000000001},"min":{"1min":0.69799999999999995,"5min":0.53500000000000003,"15min":0.40600000000000003},"max":{"1min":1.3680000000000001,"5min":1.5649999999999999,"15min":1.6339999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0580000000000001,"15min":1.0600000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.622},"max":{"1min":1.3799999999999999,"5min":1.4910000000000001,"15min":1.9259999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.069,"15min":1.089},"min":{"1min":0.752,"5min":0.61099999999999999,"15min":0.432},"max":{"1min":1.403,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0369999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:02:00 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.1379999999999999,"15min":1.143},"min":{"1min":0.93200000000000005,"5min":0.70999999999999996,"15min":0.45600000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.8480000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.1739999999999999,"15min":1.175},"min":{"1min":1.0700000000000001,"5min":0.72099999999999997,"15min":0.67600000000000005},"max":{"1min":1.4430000000000001,"5min":1.5229999999999999,"15min":1.659},"last":1.0649999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542526,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34972,"kb_used_data":7956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336868,"statfs":{"total":96636764160,"available":96600952832,"internally_reserved":0,"allocated":8146944,"data_stored":7918997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.373,"15min":0.29099999999999998},"max":{"1min":1.224,"5min":1.224,"15min":2.1629999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.33000000000000002},"max":{"1min":1.0740000000000001,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":0.77100000000000002},"min":{"1min":0.53600000000000003,"5min":0.36399999999999999,"15min":0.317},"max":{"1min":0.88100000000000001,"5min":1.861,"15min":1.861},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.62,"5min":0.39200000000000002,"15min":0.32800000000000001},"max":{"1min":1.25,"5min":1.4770000000000001,"15min":2.2490000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.87,"15min":0.82299999999999995},"min":{"1min":0.58599999999999997,"5min":0.41899999999999998,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93700000000000006,"15min":0.88400000000000001},"min":{"1min":0.69299999999999995,"5min":0.42199999999999999,"15min":0.32600000000000001},"max":{"1min":1.2729999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1},"min":{"1min":0.83999999999999997,"5min":0.56299999999999994,"15min":0.502},"max":{"1min":1.286,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0620000000000001,"15min":1.0529999999999999},"min":{"1min":0.73599999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4299999999999999,"5min":2.0750000000000002,"15min":2.3330000000000002},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.56499999999999995,"15min":0.46800000000000003},"max":{"1min":1.4039999999999999,"5min":1.909,"15min":1.909},"last":1.113},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1339999999999999,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3939999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1539999999999999,"15min":1.125},"min":{"1min":0.96999999999999997,"5min":0.73999999999999999,"15min":0.61299999999999999},"max":{"1min":1.5189999999999999,"5min":1.998,"15min":2.4500000000000002},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.163,"15min":1.149},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.831,"15min":1.964},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:01:49 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.206,"15min":1.181},"min":{"1min":0.96799999999999997,"5min":0.76500000000000001,"15min":0.61399999999999999},"max":{"1min":1.5009999999999999,"5min":1.968,"15min":1.968},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.2569999999999999,"15min":1.1850000000000001},"min":{"1min":0.86199999999999999,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.502,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":7189489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":131176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11546624,"data_stored":11514129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:02:21.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-19T05:02:21.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 Processor -- start 2024-01-19T05:02:21.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 -- start start 2024-01-19T05:02:21.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f63f80c7f30 0x7f63f806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:21.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63f806dfd0 0x7f63f8151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:21.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f815a9d0 con 0x7f63f80c8310 2024-01-19T05:02:21.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f81573e0 con 0x7f63f806dfd0 2024-01-19T05:02:21.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63ff45f640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f81576a0 con 0x7f63f80c7f30 2024-01-19T05:02:21.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63fc9fa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63f806dfd0 0x7f63f8151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:21.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63fc9fa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63f806dfd0 0x7f63f8151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43132/0 (socket says 172.21.15.133:43132) 2024-01-19T05:02:21.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1853276421 learned_addr learned my addr 172.21.15.133:0/1853276421 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:21.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.265+0000 7f63fd1fb640 1 --2- 172.21.15.133:0/1853276421 >> v2:172.21.15.156:3300/0 conn(0x7f63f80c7f30 0x7f63f806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:21.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.269+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1853276421 >> v2:172.21.15.156:3300/0 conn(0x7f63f80c7f30 msgr2=0x7f63f806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:21.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.269+0000 7f63fc9fa640 1 --2- 172.21.15.133:0/1853276421 >> v2:172.21.15.156:3300/0 conn(0x7f63f80c7f30 0x7f63f806da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.269+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1853276421 >> v1:172.21.15.156:6789/0 conn(0x7f63f80c8310 legacy=0x7f63f815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.269+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1853276421 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8157980 con 0x7f63f806dfd0 2024-01-19T05:02:21.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.273+0000 7f63fc9fa640 1 --2- 172.21.15.133:0/1853276421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f806dfd0 0x7f63f8151190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009870 tx=0x7f63f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7dbcdc0a00ffb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:21.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63f7fff640 1 -- 172.21.15.133:0/1853276421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00ab5f0 con 0x7f63f806dfd0 2024-01-19T05:02:21.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63f7fff640 1 -- 172.21.15.133:0/1853276421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00ab750 con 0x7f63f806dfd0 2024-01-19T05:02:21.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63f7fff640 1 -- 172.21.15.133:0/1853276421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00abae0 con 0x7f63f806dfd0 2024-01-19T05:02:21.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 -- 172.21.15.133:0/1853276421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f806dfd0 msgr2=0x7f63f8151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1853276421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f806dfd0 0x7f63f8151190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009870 tx=0x7f63f001c500 comp rx=0 tx=0).stop 2024-01-19T05:02:21.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 -- 172.21.15.133:0/1853276421 shutdown_connections 2024-01-19T05:02:21.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1853276421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f806dfd0 0x7f63f8151190 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1853276421 >> v2:172.21.15.156:3300/0 conn(0x7f63f80c7f30 0x7f63f806da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 -- 172.21.15.133:0/1853276421 >> 172.21.15.133:0/1853276421 conn(0x7f63f806aa60 msgr2=0x7f63f806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:21.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 -- 172.21.15.133:0/1853276421 shutdown_connections 2024-01-19T05:02:21.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 -- 172.21.15.133:0/1853276421 wait complete. 2024-01-19T05:02:21.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 Processor -- start 2024-01-19T05:02:21.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.277+0000 7f63ff45f640 1 -- start start 2024-01-19T05:02:21.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63ff45f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63f806dfd0 0x7f63f80c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:21.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63ff45f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 0x7f63f80c00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:21.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63ff45f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f80c8310 0x7f63f80c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:21.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63ff45f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80ca950 con 0x7f63f80c7f30 2024-01-19T05:02:21.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63ff45f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f81f6b70 con 0x7f63f80c8310 2024-01-19T05:02:21.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63ff45f640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80c3860 con 0x7f63f806dfd0 2024-01-19T05:02:21.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63fc9fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 0x7f63f80c00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:21.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63fc9fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 0x7f63f80c00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43142/0 (socket says 172.21.15.133:43142) 2024-01-19T05:02:21.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1872784443 learned_addr learned my addr 172.21.15.133:0/1872784443 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:21.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63fd9fc640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f80c8310 0x7f63f80c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:21.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.281+0000 7f63fd1fb640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63f806dfd0 0x7f63f80c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:21.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.285+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63f806dfd0 msgr2=0x7f63f80c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.285+0000 7f63fc9fa640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63f806dfd0 0x7f63f80c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.285+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f80c8310 msgr2=0x7f63f80c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.285+0000 7f63fc9fa640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f80c8310 0x7f63f80c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.285+0000 7f63fc9fa640 1 -- 172.21.15.133:0/1872784443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00094d0 con 0x7f63f80c7f30 2024-01-19T05:02:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.285+0000 7f63fc9fa640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 0x7f63f80c00e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63f001a130 tx=0x7f63f001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:21.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.289+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00be5f0 con 0x7f63f80c7f30 2024-01-19T05:02:21.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.289+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00be770 con 0x7f63f80c7f30 2024-01-19T05:02:21.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.289+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00beb20 con 0x7f63f80c7f30 2024-01-19T05:02:21.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.289+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f8160680 con 0x7f63f80c7f30 2024-01-19T05:02:21.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.289+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f81f66e0 con 0x7f63f80c7f30 2024-01-19T05:02:21.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.293+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f8074340 con 0x7f63f80c7f30 2024-01-19T05:02:21.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.313+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f63f00c9470 con 0x7f63f80c7f30 2024-01-19T05:02:21.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.313+0000 7f63f5ffb640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f63d8066550 0x7f63d8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:21.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.313+0000 7f63fd1fb640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f63d8066550 0x7f63d8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:21.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.313+0000 7f63fd1fb640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f63d8066550 0x7f63d8068a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63e8003b90 tx=0x7f63e80098d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:21.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.597+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f63f00a8050 con 0x7f63f80c7f30 2024-01-19T05:02:21.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.597+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f63f00ebe00 con 0x7f63f80c7f30 2024-01-19T05:02:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.769+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f63f8160680 con 0x7f63f80c7f30 2024-01-19T05:02:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.949+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f63f8160680 con 0x7f63f80c7f30 2024-01-19T05:02:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.949+0000 7f63f5ffb640 1 -- 172.21.15.133:0/1872784443 <== mon.0 v2:172.21.15.133:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f63f00ebe00 con 0x7f63f80c7f30 2024-01-19T05:02:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f63d8066550 msgr2=0x7f63d8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f63d8066550 0x7f63d8068a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63e8003b90 tx=0x7f63e80098d0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 msgr2=0x7f63f80c00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 0x7f63f80c00e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63f001a130 tx=0x7f63f001ad40 comp rx=0 tx=0).stop 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 shutdown_connections 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f63d8066550 0x7f63d8068a10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f80c8310 0x7f63f80c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f80c7f30 0x7f63f80c00e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 --2- 172.21.15.133:0/1872784443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63f806dfd0 0x7f63f80c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 >> 172.21.15.133:0/1872784443 conn(0x7f63f806aa60 msgr2=0x7f63f80c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 shutdown_connections 2024-01-19T05:02:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:21.953+0000 7f63ff45f640 1 -- 172.21.15.133:0/1872784443 wait complete. 2024-01-19T05:02:21.976 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T05:02:21.976 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:02:22.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.097+0000 7fd28cc3d640 1 Processor -- start 2024-01-19T05:02:22.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.097+0000 7fd28cc3d640 1 -- start start 2024-01-19T05:02:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd28cc3d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd288151600 0x7fd28815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd28cc3d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2881519e0 0x7fd2880c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd28cc3d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd288158390 con 0x7fd28806f350 2024-01-19T05:02:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd28cc3d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28815b0e0 con 0x7fd2881519e0 2024-01-19T05:02:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd28cc3d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd288157b70 con 0x7fd288151600 2024-01-19T05:02:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd285d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2881519e0 0x7fd2880c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd286d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd28806f350 0x7fd288157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39982/0 (socket says 172.21.15.133:39982) 2024-01-19T05:02:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.101+0000 7fd286d9d640 1 -- 172.21.15.133:0/779977776 learned_addr learned my addr 172.21.15.133:0/779977776 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:02:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.105+0000 7fd285d9b640 1 -- 172.21.15.133:0/779977776 >> v2:172.21.15.156:3300/0 conn(0x7fd288151600 msgr2=0x7fd28815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.105+0000 7fd285d9b640 1 --2- 172.21.15.133:0/779977776 >> v2:172.21.15.156:3300/0 conn(0x7fd288151600 0x7fd28815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.105+0000 7fd285d9b640 1 -- 172.21.15.133:0/779977776 >> v1:172.21.15.133:6789/0 conn(0x7fd28806f350 legacy=0x7fd288157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.105+0000 7fd285d9b640 1 -- 172.21.15.133:0/779977776 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288157dd0 con 0x7fd2881519e0 2024-01-19T05:02:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.117+0000 7fd285d9b640 1 --2- 172.21.15.133:0/779977776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2881519e0 0x7fd2880c7660 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd288066e80 tx=0x7fd27c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913b25253f1d4ddb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.121+0000 7fd28559a640 1 -- 172.21.15.133:0/779977776 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c004230 con 0x7fd2881519e0 2024-01-19T05:02:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.121+0000 7fd28559a640 1 -- 172.21.15.133:0/779977776 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd27c0a7050 con 0x7fd2881519e0 2024-01-19T05:02:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.121+0000 7fd28559a640 1 -- 172.21.15.133:0/779977776 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c003620 con 0x7fd2881519e0 2024-01-19T05:02:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.121+0000 7fd28cc3d640 1 -- 172.21.15.133:0/779977776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2881519e0 msgr2=0x7fd2880c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.121+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/779977776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2881519e0 0x7fd2880c7660 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd288066e80 tx=0x7fd27c01c460 comp rx=0 tx=0).stop 2024-01-19T05:02:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- 172.21.15.133:0/779977776 shutdown_connections 2024-01-19T05:02:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/779977776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2881519e0 0x7fd2880c7660 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/779977776 >> v2:172.21.15.156:3300/0 conn(0x7fd288151600 0x7fd28815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- 172.21.15.133:0/779977776 >> 172.21.15.133:0/779977776 conn(0x7fd28806d590 msgr2=0x7fd288066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- 172.21.15.133:0/779977776 shutdown_connections 2024-01-19T05:02:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- 172.21.15.133:0/779977776 wait complete. 2024-01-19T05:02:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 Processor -- start 2024-01-19T05:02:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- start start 2024-01-19T05:02:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 0x7fd28813f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd288151600 0x7fd2881f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2881f5bf0 0x7fd2881f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288157110 con 0x7fd28806f350 2024-01-19T05:02:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2881f2140 con 0x7fd288151600 2024-01-19T05:02:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.125+0000 7fd28cc3d640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28814b3c0 con 0x7fd2881f5bf0 2024-01-19T05:02:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.129+0000 7fd28659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 0x7fd28813f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.129+0000 7fd28659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 0x7fd28813f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39454/0 (socket says 172.21.15.133:39454) 2024-01-19T05:02:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.129+0000 7fd28659c640 1 -- 172.21.15.133:0/4163965557 learned_addr learned my addr 172.21.15.133:0/4163965557 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.133+0000 7fd286d9d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2881f5bf0 0x7fd2881f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.133+0000 7fd28659c640 1 -- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2881f5bf0 msgr2=0x7fd2881f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.133+0000 7fd28659c640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2881f5bf0 0x7fd2881f6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.133+0000 7fd28659c640 1 -- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd288151600 msgr2=0x7fd2881f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.133+0000 7fd28659c640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd288151600 0x7fd2881f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.133+0000 7fd28659c640 1 -- 172.21.15.133:0/4163965557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c009420 con 0x7fd28806f350 2024-01-19T05:02:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.137+0000 7fd28659c640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 0x7fd28813f360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b550 tx=0x7fd27800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.141+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278010870 con 0x7fd28806f350 2024-01-19T05:02:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.141+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd2780109f0 con 0x7fd28806f350 2024-01-19T05:02:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.141+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd288143280 con 0x7fd28806f350 2024-01-19T05:02:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.141+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278010dc0 con 0x7fd28806f350 2024-01-19T05:02:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.141+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2881f26a0 con 0x7fd28806f350 2024-01-19T05:02:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.141+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288071fa0 con 0x7fd28806f350 2024-01-19T05:02:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.161+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd278023480 con 0x7fd28806f350 2024-01-19T05:02:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.161+0000 7fd276ffd640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd268066550 0x7fd268068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.161+0000 7fd285d9b640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd268066550 0x7fd268068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.161+0000 7fd285d9b640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd268066550 0x7fd268068a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0ad000 tx=0x7fd27c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.161+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd2780559b0 con 0x7fd28806f350 2024-01-19T05:02:22.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.489+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd2780515f0 con 0x7fd28806f350 2024-01-19T05:02:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.745+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd288074340 con 0x7fd28806f350 2024-01-19T05:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.781+0000 7fd276ffd640 1 -- 172.21.15.133:0/4163965557 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6593 (secure 0 0 0) 0x7fd27801e090 con 0x7fd28806f350 2024-01-19T05:02:22.782 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:02:22.782 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:32:27.725491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4247,"mds_1":4238,"mds_2":4235,"mds_3":4224,"mds_4":4219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4219":{"gid":4219,"name":"d","rank":4,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4224":{"gid":4224,"name":"c","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"a","rank":1,"incarnation":11,"state":"up:active","state_seq":17,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-01-19T05:02:22.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd268066550 msgr2=0x7fd268068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd268066550 0x7fd268068a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0ad000 tx=0x7fd27c004740 comp rx=0 tx=0).stop 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 msgr2=0x7fd28813f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 0x7fd28813f360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b550 tx=0x7fd27800ba10 comp rx=0 tx=0).stop 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 shutdown_connections 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd268066550 0x7fd268068a10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd288151600 0x7fd2881f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2881f5bf0 0x7fd2881f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 --2- 172.21.15.133:0/4163965557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd28806f350 0x7fd28813f360 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 >> 172.21.15.133:0/4163965557 conn(0x7fd28806d590 msgr2=0x7fd288070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 shutdown_connections 2024-01-19T05:02:22.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.785+0000 7fd28cc3d640 1 -- 172.21.15.133:0/4163965557 wait complete. 2024-01-19T05:02:22.802 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:02:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 Processor -- start 2024-01-19T05:02:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 -- start start 2024-01-19T05:02:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7330151600 0x7f733015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f73301519e0 0x7f73300c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7330158390 con 0x7f733006f350 2024-01-19T05:02:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733015b0e0 con 0x7f7330151600 2024-01-19T05:02:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f7335c66640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7330157b70 con 0x7f73301519e0 2024-01-19T05:02:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f732f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7330151600 0x7f733015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f732f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7330151600 0x7f733015b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39464/0 (socket says 172.21.15.133:39464) 2024-01-19T05:02:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.913+0000 7f732f7fe640 1 -- 172.21.15.133:0/240955475 learned_addr learned my addr 172.21.15.133:0/240955475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.917+0000 7f732effd640 1 --2- 172.21.15.133:0/240955475 >> v2:172.21.15.156:3300/0 conn(0x7f73301519e0 0x7f73300c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.917+0000 7f732f7fe640 1 -- 172.21.15.133:0/240955475 >> v2:172.21.15.156:3300/0 conn(0x7f73301519e0 msgr2=0x7f73300c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.917+0000 7f732f7fe640 1 --2- 172.21.15.133:0/240955475 >> v2:172.21.15.156:3300/0 conn(0x7f73301519e0 0x7f73300c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.917+0000 7f732f7fe640 1 -- 172.21.15.133:0/240955475 >> v1:172.21.15.156:6789/0 conn(0x7f733006f350 legacy=0x7f7330157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.917+0000 7f732f7fe640 1 -- 172.21.15.133:0/240955475 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330157dd0 con 0x7f7330151600 2024-01-19T05:02:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.921+0000 7f732f7fe640 1 --2- 172.21.15.133:0/240955475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7330151600 0x7f733015b570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73300cbe90 tx=0x7f732001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c045f4ef6410e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f732e7fc640 1 -- 172.21.15.133:0/240955475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200a5740 con 0x7f7330151600 2024-01-19T05:02:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f732e7fc640 1 -- 172.21.15.133:0/240955475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f73200a58a0 con 0x7f7330151600 2024-01-19T05:02:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f732e7fc640 1 -- 172.21.15.133:0/240955475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200a5c50 con 0x7f7330151600 2024-01-19T05:02:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 -- 172.21.15.133:0/240955475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7330151600 msgr2=0x7f733015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 --2- 172.21.15.133:0/240955475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7330151600 0x7f733015b570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73300cbe90 tx=0x7f732001c990 comp rx=0 tx=0).stop 2024-01-19T05:02:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 -- 172.21.15.133:0/240955475 shutdown_connections 2024-01-19T05:02:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 --2- 172.21.15.133:0/240955475 >> v2:172.21.15.156:3300/0 conn(0x7f73301519e0 0x7f73300c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 --2- 172.21.15.133:0/240955475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7330151600 0x7f733015b570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 -- 172.21.15.133:0/240955475 >> 172.21.15.133:0/240955475 conn(0x7f733006d590 msgr2=0x7f7330066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 -- 172.21.15.133:0/240955475 shutdown_connections 2024-01-19T05:02:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.925+0000 7f7335c66640 1 -- 172.21.15.133:0/240955475 wait complete. 2024-01-19T05:02:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 Processor -- start 2024-01-19T05:02:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 -- start start 2024-01-19T05:02:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f733006f350 0x7f7330141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7330159540 0x7f73300c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 0x7f73301f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73301446d0 con 0x7f73301f2040 2024-01-19T05:02:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7330140b10 con 0x7f7330159540 2024-01-19T05:02:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f7335c66640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7330143f60 con 0x7f733006f350 2024-01-19T05:02:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f732ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 0x7f73301f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f732ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 0x7f73301f24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39466/0 (socket says 172.21.15.133:39466) 2024-01-19T05:02:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.929+0000 7f732ffff640 1 -- 172.21.15.133:0/3744261800 learned_addr learned my addr 172.21.15.133:0/3744261800 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732f7fe640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f733006f350 0x7f7330141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732effd640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7330159540 0x7f73300c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732ffff640 1 -- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f733006f350 msgr2=0x7f7330141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732ffff640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f733006f350 0x7f7330141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732ffff640 1 -- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7330159540 msgr2=0x7f73300c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732ffff640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7330159540 0x7f73300c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.933+0000 7f732ffff640 1 -- 172.21.15.133:0/3744261800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009b30 con 0x7f73301f2040 2024-01-19T05:02:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.937+0000 7f732ffff640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 0x7f73301f24c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f732800c470 tx=0x7f732800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.941+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328003600 con 0x7f73301f2040 2024-01-19T05:02:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.941+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7328003760 con 0x7f73301f2040 2024-01-19T05:02:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.941+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328003b30 con 0x7f73301f2040 2024-01-19T05:02:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.941+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7330144240 con 0x7f73301f2040 2024-01-19T05:02:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.941+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7330159cb0 con 0x7f73301f2040 2024-01-19T05:02:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.941+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73301443d0 con 0x7f73301f2040 2024-01-19T05:02:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.965+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7328003c90 con 0x7f73301f2040 2024-01-19T05:02:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.965+0000 7f7317fff640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f731c066500 0x7f731c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:22.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.969+0000 7f732f7fe640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f731c066500 0x7f731c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.969+0000 7f732f7fe640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f731c066500 0x7f731c0689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f73200ae000 tx=0x7f73200a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:22.969+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7328054830 con 0x7f73301f2040 2024-01-19T05:02:23.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.245+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7328081e60 con 0x7f73301f2040 2024-01-19T05:02:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.445+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73300c2550 con 0x7f73301f2040 2024-01-19T05:02:23.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.473+0000 7f7317fff640 1 -- 172.21.15.133:0/3744261800 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6593 (secure 0 0 0) 0x7f7328017030 con 0x7f73301f2040 2024-01-19T05:02:23.475 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:02:23.475 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/716260735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":716260735},{"type":"v1","addr":"172.21.15.156:6835","nonce":716260735}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:31:32.688148+0000","modified":"2024-01-19T04:32:27.725491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4247,"mds_1":4238,"mds_2":4235,"mds_3":4224,"mds_4":4219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4219":{"gid":4219,"name":"d","rank":4,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.156:6837/1010982960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1010982960},{"type":"v1","addr":"172.21.15.156:6837","nonce":1010982960}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4224":{"gid":4224,"name":"c","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.133:6833/383272692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":383272692},{"type":"v1","addr":"172.21.15.133:6833","nonce":383272692}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4235":{"gid":4235,"name":"f","rank":2,"incarnation":15,"state":"up:active","state_seq":18,"addr":"172.21.15.156:6839/1170572203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1170572203},{"type":"v1","addr":"172.21.15.156:6839","nonce":1170572203}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4238":{"gid":4238,"name":"a","rank":1,"incarnation":11,"state":"up:active","state_seq":17,"addr":"172.21.15.133:6835/3627758076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3627758076},{"type":"v1","addr":"172.21.15.133:6835","nonce":3627758076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4247":{"gid":4247,"name":"e","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6837/3631439971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3631439971},{"type":"v1","addr":"172.21.15.133:6837","nonce":3631439971}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:02:23.475 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-01-19T05:02:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f731c066500 msgr2=0x7f731c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f731c066500 0x7f731c0689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f73200ae000 tx=0x7f73200a7070 comp rx=0 tx=0).stop 2024-01-19T05:02:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 msgr2=0x7f73301f24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 0x7f73301f24c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f732800c470 tx=0x7f732800c930 comp rx=0 tx=0).stop 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 shutdown_connections 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f731c066500 0x7f731c0689c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7330159540 0x7f73300c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73301f2040 0x7f73301f24c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 --2- 172.21.15.133:0/3744261800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f733006f350 0x7f7330141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 >> 172.21.15.133:0/3744261800 conn(0x7f733006d590 msgr2=0x7f733014fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 shutdown_connections 2024-01-19T05:02:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.477+0000 7f7335c66640 1 -- 172.21.15.133:0/3744261800 wait complete. 2024-01-19T05:02:23.495 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:02:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 Processor -- start 2024-01-19T05:02:23.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 -- start start 2024-01-19T05:02:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 0x7f814815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f814806f350 0x7f81480c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8148158390 con 0x7f8148151600 2024-01-19T05:02:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814815b0e0 con 0x7f814806f350 2024-01-19T05:02:23.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.625+0000 7f814ffb4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148157b70 con 0x7f81481519e0 2024-01-19T05:02:23.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.685+0000 7f814d54f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 0x7f814815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:23.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.685+0000 7f814e551640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f814806f350 0x7f81480c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:23.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.689+0000 7f814d54f640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 0x7f814815b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:53056/0 (socket says 172.21.15.133:53056) 2024-01-19T05:02:23.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.689+0000 7f814d54f640 1 -- 172.21.15.133:0/3641811307 learned_addr learned my addr 172.21.15.133:0/3641811307 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.693+0000 7f814d54f640 1 -- 172.21.15.133:0/3641811307 >> v2:172.21.15.156:3300/0 conn(0x7f814806f350 msgr2=0x7f81480c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.693+0000 7f814d54f640 1 --2- 172.21.15.133:0/3641811307 >> v2:172.21.15.156:3300/0 conn(0x7f814806f350 0x7f81480c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.693+0000 7f814d54f640 1 -- 172.21.15.133:0/3641811307 >> v1:172.21.15.156:6789/0 conn(0x7f8148151600 legacy=0x7f8148157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.693+0000 7f814d54f640 1 -- 172.21.15.133:0/3641811307 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148157dd0 con 0x7f81481519e0 2024-01-19T05:02:23.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.701+0000 7f814d54f640 1 --2- 172.21.15.133:0/3641811307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 0x7f814815b570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f813c009870 tx=0x7f813c01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4184abda544b84d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:23.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814cd4e640 1 -- 172.21.15.133:0/3641811307 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0ac410 con 0x7f81481519e0 2024-01-19T05:02:23.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814cd4e640 1 -- 172.21.15.133:0/3641811307 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f813c0ac570 con 0x7f81481519e0 2024-01-19T05:02:23.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814cd4e640 1 -- 172.21.15.133:0/3641811307 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0ac920 con 0x7f81481519e0 2024-01-19T05:02:23.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 -- 172.21.15.133:0/3641811307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 msgr2=0x7f814815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 --2- 172.21.15.133:0/3641811307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 0x7f814815b570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f813c009870 tx=0x7f813c01c500 comp rx=0 tx=0).stop 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 -- 172.21.15.133:0/3641811307 shutdown_connections 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 --2- 172.21.15.133:0/3641811307 >> v2:172.21.15.156:3300/0 conn(0x7f814806f350 0x7f81480c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 --2- 172.21.15.133:0/3641811307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481519e0 0x7f814815b570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 -- 172.21.15.133:0/3641811307 >> 172.21.15.133:0/3641811307 conn(0x7f814806d590 msgr2=0x7f8148066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 -- 172.21.15.133:0/3641811307 shutdown_connections 2024-01-19T05:02:23.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.709+0000 7f814ffb4640 1 -- 172.21.15.133:0/3641811307 wait complete. 2024-01-19T05:02:23.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 Processor -- start 2024-01-19T05:02:23.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 -- start start 2024-01-19T05:02:23.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f814806f350 0x7f814814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148151600 0x7f81481f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481576a0 0x7f81481f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814814f160 con 0x7f8148151600 2024-01-19T05:02:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481f6400 con 0x7f81481576a0 2024-01-19T05:02:23.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.713+0000 7f814ffb4640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81481f5f70 con 0x7f814806f350 2024-01-19T05:02:23.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.717+0000 7f814e551640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481576a0 0x7f81481f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:23.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.717+0000 7f814e551640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481576a0 0x7f81481f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.133:54122/0 (socket says 172.21.15.133:54122) 2024-01-19T05:02:23.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.717+0000 7f814e551640 1 -- 172.21.15.133:0/1476591564 learned_addr learned my addr 172.21.15.133:0/1476591564 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:23.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.717+0000 7f814dd50640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f814806f350 0x7f814814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:23.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.725+0000 7f814dd50640 1 -- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481576a0 msgr2=0x7f81481f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:23.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.725+0000 7f814dd50640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481576a0 0x7f81481f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.725+0000 7f814dd50640 1 -- 172.21.15.133:0/1476591564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148151600 msgr2=0x7f81481f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:23.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.725+0000 7f814dd50640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148151600 0x7f81481f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:23.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.725+0000 7f814dd50640 1 -- 172.21.15.133:0/1476591564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0094d0 con 0x7f814806f350 2024-01-19T05:02:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.729+0000 7f814dd50640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f814806f350 0x7f814814ff80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f814000c700 tx=0x7f814000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.805+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000aa50 con 0x7f814806f350 2024-01-19T05:02:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.805+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f814000abb0 con 0x7f814806f350 2024-01-19T05:02:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.805+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81480c7760 con 0x7f814806f350 2024-01-19T05:02:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.805+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000ce10 con 0x7f814806f350 2024-01-19T05:02:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.805+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81481f5640 con 0x7f814806f350 2024-01-19T05:02:23.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.809+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8148071fa0 con 0x7f814806f350 2024-01-19T05:02:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.849+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8140012420 con 0x7f814806f350 2024-01-19T05:02:23.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.853+0000 7f81467fc640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8134066580 0x7f8134068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.853+0000 7f814d54f640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8134066580 0x7f8134068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:23.853+0000 7f814d54f640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8134066580 0x7f8134068a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f813c0ae000 tx=0x7f813c004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.113+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8140056020 con 0x7f814806f350 2024-01-19T05:02:24.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.145+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8140051bd0 con 0x7f814806f350 2024-01-19T05:02:24.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.313+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8148074340 con 0x7f814806f350 2024-01-19T05:02:24.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.369+0000 7f81467fc640 1 -- 172.21.15.133:0/1476591564 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18782 (secure 0 0 0) 0x7f8140016030 con 0x7f814806f350 2024-01-19T05:02:24.371 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-19T05:02:24.372 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":31,"fsid":"d3166d6e-d1d2-4f45-9af8-af169e4e9af8","created":"2024-01-19T04:30:26.132616+0000","modified":"2024-01-19T04:32:36.898530+0000","last_up_change":"2024-01-19T04:30:48.637794+0000","last_in_change":"2024-01-19T04:30:37.220098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:30:46.253162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:31:30.230778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:31:31.446896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-19T04:31:37.539878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b0777239-db39-43f3-9d79-68d520aebea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6801","nonce":1465777875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6803","nonce":1465777875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6807","nonce":1465777875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1465777875},{"type":"v1","addr":"172.21.15.133:6805","nonce":1465777875}]},"public_addr":"172.21.15.133:6801/1465777875","cluster_addr":"172.21.15.133:6803/1465777875","heartbeat_back_addr":"172.21.15.133:6807/1465777875","heartbeat_front_addr":"172.21.15.133:6805/1465777875","state":["exists","up"]},{"osd":1,"uuid":"1f203406-a6f3-4ab9-81bf-4af5da0c0ca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6817","nonce":2799296662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6819","nonce":2799296662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6823","nonce":2799296662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2799296662},{"type":"v1","addr":"172.21.15.133:6821","nonce":2799296662}]},"public_addr":"172.21.15.133:6817/2799296662","cluster_addr":"172.21.15.133:6819/2799296662","heartbeat_back_addr":"172.21.15.133:6823/2799296662","heartbeat_front_addr":"172.21.15.133:6821/2799296662","state":["exists","up"]},{"osd":2,"uuid":"c4baddb0-79b2-47ca-9fce-962d2298dd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6809","nonce":2653064077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6811","nonce":2653064077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6815","nonce":2653064077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2653064077},{"type":"v1","addr":"172.21.15.133:6813","nonce":2653064077}]},"public_addr":"172.21.15.133:6809/2653064077","cluster_addr":"172.21.15.133:6811/2653064077","heartbeat_back_addr":"172.21.15.133:6815/2653064077","heartbeat_front_addr":"172.21.15.133:6813/2653064077","state":["exists","up"]},{"osd":3,"uuid":"9addb9ba-1d54-47dc-a6ab-a48ec2c3e47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6825","nonce":2044063014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6827","nonce":2044063014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6831","nonce":2044063014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2044063014},{"type":"v1","addr":"172.21.15.133:6829","nonce":2044063014}]},"public_addr":"172.21.15.133:6825/2044063014","cluster_addr":"172.21.15.133:6827/2044063014","heartbeat_back_addr":"172.21.15.133:6831/2044063014","heartbeat_front_addr":"172.21.15.133:6829/2044063014","state":["exists","up"]},{"osd":4,"uuid":"de82b90b-98c5-4123-a7f9-7d16ea185376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6811","nonce":3494223144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6813","nonce":3494223144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6817","nonce":3494223144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3494223144},{"type":"v1","addr":"172.21.15.156:6815","nonce":3494223144}]},"public_addr":"172.21.15.156:6811/3494223144","cluster_addr":"172.21.15.156:6813/3494223144","heartbeat_back_addr":"172.21.15.156:6817/3494223144","heartbeat_front_addr":"172.21.15.156:6815/3494223144","state":["exists","up"]},{"osd":5,"uuid":"804e44dc-27a7-406a-a493-9fabc752b3a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6820","nonce":1488223936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6824","nonce":1488223936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6832","nonce":1488223936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1488223936},{"type":"v1","addr":"172.21.15.156:6828","nonce":1488223936}]},"public_addr":"172.21.15.156:6820/1488223936","cluster_addr":"172.21.15.156:6824/1488223936","heartbeat_back_addr":"172.21.15.156:6832/1488223936","heartbeat_front_addr":"172.21.15.156:6828/1488223936","state":["exists","up"]},{"osd":6,"uuid":"4814caa0-7810-463f-af0c-a608320ede1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6821","nonce":2521997623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6823","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6825","nonce":2521997623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6831","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6833","nonce":2521997623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":2521997623},{"type":"v1","addr":"172.21.15.156:6829","nonce":2521997623}]},"public_addr":"172.21.15.156:6821/2521997623","cluster_addr":"172.21.15.156:6825/2521997623","heartbeat_back_addr":"172.21.15.156:6833/2521997623","heartbeat_front_addr":"172.21.15.156:6829/2521997623","state":["exists","up"]},{"osd":7,"uuid":"fbd4ba15-8512-4dce-98d0-8accfad46c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6803","nonce":413680273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6805","nonce":413680273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6809","nonce":413680273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":413680273},{"type":"v1","addr":"172.21.15.156:6807","nonce":413680273}]},"public_addr":"172.21.15.156:6803/413680273","cluster_addr":"172.21.15.156:6805/413680273","heartbeat_back_addr":"172.21.15.156:6809/413680273","heartbeat_front_addr":"172.21.15.156:6807/413680273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.112079+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.207065+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.272965+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.344724+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.244218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.282059+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.345862+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:30:43.233384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:02:24.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.373+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8134066580 msgr2=0x7f8134068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:24.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.373+0000 7f814ffb4640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8134066580 0x7f8134068a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f813c0ae000 tx=0x7f813c004740 comp rx=0 tx=0).stop 2024-01-19T05:02:24.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.373+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f814806f350 msgr2=0x7f814814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.373+0000 7f814ffb4640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f814806f350 0x7f814814ff80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f814000c700 tx=0x7f814000cbc0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 shutdown_connections 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f8134066580 0x7f8134068a40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481576a0 0x7f81481f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148151600 0x7f81481f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 --2- 172.21.15.133:0/1476591564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f814806f350 0x7f814814ff80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 >> 172.21.15.133:0/1476591564 conn(0x7f814806d590 msgr2=0x7f81480c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 shutdown_connections 2024-01-19T05:02:24.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.377+0000 7f814ffb4640 1 -- 172.21.15.133:0/1476591564 wait complete. 2024-01-19T05:02:24.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T05:02:24.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 Processor -- start 2024-01-19T05:02:24.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 -- start start 2024-01-19T05:02:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6190 0x7fe0240c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0240c7620 0x7fe0241507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0240c5220 con 0x7fe0240c6570 2024-01-19T05:02:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0240c5a50 con 0x7fe0240c7620 2024-01-19T05:02:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe02b043640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe024157260 con 0x7fe0240c6190 2024-01-19T05:02:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe0295e0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0240c7620 0x7fe0241507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe023fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe0240c6570 0x7fe024150090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39988/0 (socket says 172.21.15.133:39988) 2024-01-19T05:02:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.525+0000 7fe023fff640 1 -- 172.21.15.133:0/380662724 learned_addr learned my addr 172.21.15.133:0/380662724 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:02:24.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.529+0000 7fe028ddf640 1 --2- 172.21.15.133:0/380662724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6190 0x7fe0240c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.529+0000 7fe0295e0640 1 -- 172.21.15.133:0/380662724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6190 msgr2=0x7fe0240c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.529+0000 7fe0295e0640 1 --2- 172.21.15.133:0/380662724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6190 0x7fe0240c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.529+0000 7fe0295e0640 1 -- 172.21.15.133:0/380662724 >> v1:172.21.15.133:6789/0 conn(0x7fe0240c6570 legacy=0x7fe024150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:24.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.529+0000 7fe0295e0640 1 -- 172.21.15.133:0/380662724 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240c5490 con 0x7fe0240c7620 2024-01-19T05:02:24.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.533+0000 7fe0295e0640 1 --2- 172.21.15.133:0/380662724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241507a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009d90 tx=0x7fe01c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb1384cf90a617a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:24.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe0237fe640 1 -- 172.21.15.133:0/380662724 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0a5950 con 0x7fe0240c7620 2024-01-19T05:02:24.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe0237fe640 1 -- 172.21.15.133:0/380662724 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe01c0a5ab0 con 0x7fe0240c7620 2024-01-19T05:02:24.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe0237fe640 1 -- 172.21.15.133:0/380662724 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0a5e60 con 0x7fe0240c7620 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 -- 172.21.15.133:0/380662724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 msgr2=0x7fe0241507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 --2- 172.21.15.133:0/380662724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241507a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009d90 tx=0x7fe01c01c890 comp rx=0 tx=0).stop 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 -- 172.21.15.133:0/380662724 shutdown_connections 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 --2- 172.21.15.133:0/380662724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241507a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 --2- 172.21.15.133:0/380662724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6190 0x7fe0240c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 -- 172.21.15.133:0/380662724 >> 172.21.15.133:0/380662724 conn(0x7fe02406fa20 msgr2=0x7fe0240c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 -- 172.21.15.133:0/380662724 shutdown_connections 2024-01-19T05:02:24.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 -- 172.21.15.133:0/380662724 wait complete. 2024-01-19T05:02:24.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 Processor -- start 2024-01-19T05:02:24.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.541+0000 7fe02b043640 1 -- start start 2024-01-19T05:02:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe02b043640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0240c6190 0x7fe024147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe02b043640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6570 0x7fe0241ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe02b043640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241efee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe02b043640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0241465b0 con 0x7fe0240c7620 2024-01-19T05:02:24.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe02b043640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0241ef4a0 con 0x7fe0240c6190 2024-01-19T05:02:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe02b043640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe024143fb0 con 0x7fe0240c6570 2024-01-19T05:02:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe0295e0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241efee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe0295e0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241efee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39476/0 (socket says 172.21.15.133:39476) 2024-01-19T05:02:24.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe0295e0640 1 -- 172.21.15.133:0/4136959217 learned_addr learned my addr 172.21.15.133:0/4136959217 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe023fff640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6570 0x7fe0241ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:24.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.545+0000 7fe028ddf640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0240c6190 0x7fe024147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:24.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.549+0000 7fe0295e0640 1 -- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6570 msgr2=0x7fe0241ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.549+0000 7fe0295e0640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6570 0x7fe0241ef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.549+0000 7fe0295e0640 1 -- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0240c6190 msgr2=0x7fe024147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.549+0000 7fe0295e0640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0240c6190 0x7fe024147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:24.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.549+0000 7fe0295e0640 1 -- 172.21.15.133:0/4136959217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c009a70 con 0x7fe0240c7620 2024-01-19T05:02:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.549+0000 7fe0295e0640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241efee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0b0040 tx=0x7fe01c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.553+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0addb0 con 0x7fe0240c7620 2024-01-19T05:02:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.553+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe01c009450 con 0x7fe0240c7620 2024-01-19T05:02:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.553+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0b9670 con 0x7fe0240c7620 2024-01-19T05:02:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.553+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe024144290 con 0x7fe0240c7620 2024-01-19T05:02:24.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.553+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe024144850 con 0x7fe0240c7620 2024-01-19T05:02:24.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.557+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe024066c70 con 0x7fe0240c7620 2024-01-19T05:02:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.577+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe01c0b97d0 con 0x7fe0240c7620 2024-01-19T05:02:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.577+0000 7fe0217fa640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe010066550 0x7fe010068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.577+0000 7fe028ddf640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe010066550 0x7fe010068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.577+0000 7fe028ddf640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe010066550 0x7fe010068a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe014009ac0 tx=0x7fe014009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.877+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe01c0f11a0 con 0x7fe0240c7620 2024-01-19T05:02:24.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:24.877+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe01c0ed450 con 0x7fe0240c7620 2024-01-19T05:02:25.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.085+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe0241ef6c0 con 0x7fe0240c7620 2024-01-19T05:02:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.409+0000 7fe0217fa640 1 -- 172.21.15.133:0/4136959217 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0241ef6c0 con 0x7fe0240c7620 2024-01-19T05:02:25.411 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe010066550 msgr2=0x7fe010068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe010066550 0x7fe010068a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe014009ac0 tx=0x7fe014009190 comp rx=0 tx=0).stop 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 msgr2=0x7fe0241efee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241efee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0b0040 tx=0x7fe01c019630 comp rx=0 tx=0).stop 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 shutdown_connections 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fe010066550 0x7fe010068a10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0240c7620 0x7fe0241efee0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0240c6570 0x7fe0241ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 --2- 172.21.15.133:0/4136959217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0240c6190 0x7fe024147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 >> 172.21.15.133:0/4136959217 conn(0x7fe02406fa20 msgr2=0x7fe02414ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 shutdown_connections 2024-01-19T05:02:25.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.417+0000 7fe02b043640 1 -- 172.21.15.133:0/4136959217 wait complete. 2024-01-19T05:02:25.442 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T05:02:25.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.569+0000 7f7ea5b46640 1 Processor -- start 2024-01-19T05:02:25.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.569+0000 7f7ea5b46640 1 -- start start 2024-01-19T05:02:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7ea5b46640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ea0153800 0x7f7ea01596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7ea5b46640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ea00cc3e0 0x7f7ea015d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7ea5b46640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea0159d50 con 0x7f7ea006fc50 2024-01-19T05:02:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7ea5b46640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea0159ff0 con 0x7f7ea0153800 2024-01-19T05:02:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7ea5b46640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea015a2b0 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7e9f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ea0153800 0x7f7ea01596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:25.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7e9effd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ea00cc3e0 0x7f7ea015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:25.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7e9ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7ea006fc50 0x7f7ea006a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40002/0 (socket says 172.21.15.133:40002) 2024-01-19T05:02:25.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.573+0000 7f7e9ffff640 1 -- 172.21.15.133:0/3664645535 learned_addr learned my addr 172.21.15.133:0/3664645535 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:02:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.581+0000 7f7e9effd640 1 -- 172.21.15.133:0/3664645535 >> v2:172.21.15.133:3300/0 conn(0x7f7ea0153800 msgr2=0x7f7ea01596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.581+0000 7f7e9effd640 1 --2- 172.21.15.133:0/3664645535 >> v2:172.21.15.133:3300/0 conn(0x7f7ea0153800 0x7f7ea01596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.581+0000 7f7e9effd640 1 -- 172.21.15.133:0/3664645535 >> v1:172.21.15.133:6789/0 conn(0x7f7ea006fc50 legacy=0x7f7ea006a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.581+0000 7f7e9effd640 1 -- 172.21.15.133:0/3664645535 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea015cd50 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.585+0000 7f7e9effd640 1 --2- 172.21.15.133:0/3664645535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea015d550 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00c8d60 tx=0x7f7e9401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32a5c586f7ffe546 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7e9e7fc640 1 -- 172.21.15.133:0/3664645535 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940ab600 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7e9e7fc640 1 -- 172.21.15.133:0/3664645535 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7e940a7050 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7e9e7fc640 1 -- 172.21.15.133:0/3664645535 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940ab9a0 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 -- 172.21.15.133:0/3664645535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea00cc3e0 msgr2=0x7f7ea015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/3664645535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea015d550 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00c8d60 tx=0x7f7e9401c3d0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 -- 172.21.15.133:0/3664645535 shutdown_connections 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/3664645535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea015d550 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/3664645535 >> v2:172.21.15.133:3300/0 conn(0x7f7ea0153800 0x7f7ea01596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 -- 172.21.15.133:0/3664645535 >> 172.21.15.133:0/3664645535 conn(0x7f7ea0072890 msgr2=0x7f7ea006e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 -- 172.21.15.133:0/3664645535 shutdown_connections 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 -- 172.21.15.133:0/3664645535 wait complete. 2024-01-19T05:02:25.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 Processor -- start 2024-01-19T05:02:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.593+0000 7f7ea5b46640 1 -- start start 2024-01-19T05:02:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7ea5b46640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea006fc50 0x7f7ea01f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7ea5b46640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea01f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7ea5b46640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ea0153800 0x7f7ea0156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7ea5b46640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00c4c40 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7ea5b46640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01f2e50 con 0x7f7ea006fc50 2024-01-19T05:02:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7ea5b46640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01f33d0 con 0x7f7ea0153800 2024-01-19T05:02:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7e9effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea01f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7e9effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea01f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39500/0 (socket says 172.21.15.133:39500) 2024-01-19T05:02:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7e9effd640 1 -- 172.21.15.133:0/2441691169 learned_addr learned my addr 172.21.15.133:0/2441691169 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7e9ffff640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ea0153800 0x7f7ea0156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.597+0000 7f7e9f7fe640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea006fc50 0x7f7ea01f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:25.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.601+0000 7f7e9effd640 1 -- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ea0153800 msgr2=0x7f7ea0156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.601+0000 7f7e9effd640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ea0153800 0x7f7ea0156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.601+0000 7f7e9effd640 1 -- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea006fc50 msgr2=0x7f7ea01f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.601+0000 7f7e9effd640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea006fc50 0x7f7ea01f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:25.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.601+0000 7f7e9effd640 1 -- 172.21.15.133:0/2441691169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94009420 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.605+0000 7f7e9effd640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea01f3860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e94018fe0 tx=0x7f7e94019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:25.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.613+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940b4400 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.613+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7e940b4560 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.613+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea01f72e0 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.613+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940b48d0 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.613+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea01f3da0 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.613+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea01f3560 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.641+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7e940b2040 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.641+0000 7f7e87fff640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e8c066500 0x7f7e8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.641+0000 7f7e9f7fe640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e8c066500 0x7f7e8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.641+0000 7f7e9f7fe640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e8c066500 0x7f7e8c0689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009ac0 tx=0x7f7e90009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:25.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.921+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f7e940ef7b0 con 0x7f7ea00cc3e0 2024-01-19T05:02:25.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:25.921+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7e940eba60 con 0x7f7ea00cc3e0 2024-01-19T05:02:26.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:26.209+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7ea0074340 con 0x7f7ea00cc3e0 2024-01-19T05:02:27.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7e87fff640 1 -- 172.21.15.133:0/2441691169 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e940b0070 con 0x7f7ea00cc3e0 2024-01-19T05:02:27.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e8c066500 msgr2=0x7f7e8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e8c066500 0x7f7e8c0689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009ac0 tx=0x7f7e90009190 comp rx=0 tx=0).stop 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 msgr2=0x7f7ea01f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea01f3860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e94018fe0 tx=0x7f7e94019170 comp rx=0 tx=0).stop 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 shutdown_connections 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f7e8c066500 0x7f7e8c0689c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ea0153800 0x7f7ea0156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea00cc3e0 0x7f7ea01f3860 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 --2- 172.21.15.133:0/2441691169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ea006fc50 0x7f7ea01f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 >> 172.21.15.133:0/2441691169 conn(0x7f7ea0072890 msgr2=0x7f7ea0152a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 shutdown_connections 2024-01-19T05:02:27.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.237+0000 7f7ea5b46640 1 -- 172.21.15.133:0/2441691169 wait complete. 2024-01-19T05:02:27.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T05:02:27.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.365+0000 7f5cadea5640 1 Processor -- start 2024-01-19T05:02:27.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.365+0000 7f5cadea5640 1 -- start start 2024-01-19T05:02:27.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5cadea5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ca80c8820 0x7f5ca80c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:27.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5cadea5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca80c94b0 con 0x7f5ca815d010 2024-01-19T05:02:27.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5cadea5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca80c6730 con 0x7f5ca81539c0 2024-01-19T05:02:27.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5cadea5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca8159860 con 0x7f5ca80c8820 2024-01-19T05:02:27.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5ca7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ca80c8820 0x7f5ca80c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:27.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5ca6ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5ca815d010 0x7f5ca815d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40014/0 (socket says 172.21.15.133:40014) 2024-01-19T05:02:27.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.369+0000 7f5ca6ffd640 1 -- 172.21.15.133:0/44176015 learned_addr learned my addr 172.21.15.133:0/44176015 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:02:27.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.373+0000 7f5ca67fc640 1 -- 172.21.15.133:0/44176015 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813358391 0 0) 0x7f5ca80c6730 con 0x7f5ca81539c0 2024-01-19T05:02:27.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.373+0000 7f5ca67fc640 1 -- 172.21.15.133:0/44176015 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c90003530 con 0x7f5ca81539c0 2024-01-19T05:02:27.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.373+0000 7f5ca7fff640 1 -- 172.21.15.133:0/44176015 >> v1:172.21.15.156:6789/0 conn(0x7f5ca81539c0 legacy=0x7f5ca806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.373+0000 7f5ca7fff640 1 -- 172.21.15.133:0/44176015 >> v1:172.21.15.133:6789/0 conn(0x7f5ca815d010 legacy=0x7f5ca815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.373+0000 7f5ca7fff640 1 -- 172.21.15.133:0/44176015 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8159b40 con 0x7f5ca80c8820 2024-01-19T05:02:27.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.381+0000 7f5ca7fff640 1 --2- 172.21.15.133:0/44176015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80c8c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009d90 tx=0x7f5ca001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c09ccee1ed99ae server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:27.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5ca67fc640 1 -- 172.21.15.133:0/44176015 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00af600 con 0x7f5ca80c8820 2024-01-19T05:02:27.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5ca67fc640 1 -- 172.21.15.133:0/44176015 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5ca00ab050 con 0x7f5ca80c8820 2024-01-19T05:02:27.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5ca67fc640 1 -- 172.21.15.133:0/44176015 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00af9a0 con 0x7f5ca80c8820 2024-01-19T05:02:27.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 -- 172.21.15.133:0/44176015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 msgr2=0x7f5ca80c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 --2- 172.21.15.133:0/44176015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80c8c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009d90 tx=0x7f5ca001f130 comp rx=0 tx=0).stop 2024-01-19T05:02:27.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 -- 172.21.15.133:0/44176015 shutdown_connections 2024-01-19T05:02:27.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 --2- 172.21.15.133:0/44176015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80c8c70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 -- 172.21.15.133:0/44176015 >> 172.21.15.133:0/44176015 conn(0x7f5ca8066890 msgr2=0x7f5ca8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 -- 172.21.15.133:0/44176015 shutdown_connections 2024-01-19T05:02:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.385+0000 7f5cadea5640 1 -- 172.21.15.133:0/44176015 wait complete. 2024-01-19T05:02:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 Processor -- start 2024-01-19T05:02:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 -- start start 2024-01-19T05:02:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ca81539c0 0x7f5ca81e3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ca815d010 0x7f5ca814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80cba70 con 0x7f5ca80c8820 2024-01-19T05:02:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80cb790 con 0x7f5ca81539c0 2024-01-19T05:02:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5cadea5640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81e59f0 con 0x7f5ca815d010 2024-01-19T05:02:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5ca77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5ca77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39518/0 (socket says 172.21.15.133:39518) 2024-01-19T05:02:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5ca77fe640 1 -- 172.21.15.133:0/578405429 learned_addr learned my addr 172.21.15.133:0/578405429 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5ca6ffd640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ca81539c0 0x7f5ca81e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.389+0000 7f5ca7fff640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ca815d010 0x7f5ca814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:27.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.393+0000 7f5ca77fe640 1 -- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ca815d010 msgr2=0x7f5ca814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.393+0000 7f5ca77fe640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ca815d010 0x7f5ca814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.397+0000 7f5ca77fe640 1 -- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ca81539c0 msgr2=0x7f5ca81e3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:27.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.397+0000 7f5ca77fe640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ca81539c0 0x7f5ca81e3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:27.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.397+0000 7f5ca77fe640 1 -- 172.21.15.133:0/578405429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0009a70 con 0x7f5ca80c8820 2024-01-19T05:02:27.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.397+0000 7f5ca77fe640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80caf50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c430 tx=0x7f5c9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.409+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c980052d0 con 0x7f5ca80c8820 2024-01-19T05:02:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.409+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5c98005450 con 0x7f5ca80c8820 2024-01-19T05:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.409+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98003860 con 0x7f5ca80c8820 2024-01-19T05:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.409+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca81e5cd0 con 0x7f5ca80c8820 2024-01-19T05:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.409+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca81e6290 con 0x7f5ca80c8820 2024-01-19T05:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.409+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8074340 con 0x7f5ca80c8820 2024-01-19T05:02:27.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.437+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5c980039c0 con 0x7f5ca80c8820 2024-01-19T05:02:27.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.437+0000 7f5c8ffff640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5c94066530 0x7f5c940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:27.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.437+0000 7f5ca6ffd640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5c94066530 0x7f5c940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:27.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.441+0000 7f5ca6ffd640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5c94066530 0x7f5c940689f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80cc310 tx=0x7f5c9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.689+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f5c98054930 con 0x7f5ca80c8820 2024-01-19T05:02:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.689+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5c98050be0 con 0x7f5ca80c8820 2024-01-19T05:02:27.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:27.853+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ca80c8600 con 0x7f5ca80c8820 2024-01-19T05:02:28.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.349+0000 7f5c8ffff640 1 -- 172.21.15.133:0/578405429 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5c98017070 con 0x7f5ca80c8820 2024-01-19T05:02:28.348 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5c94066530 msgr2=0x7f5c940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5c94066530 0x7f5c940689f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80cc310 tx=0x7f5c9c009040 comp rx=0 tx=0).stop 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 msgr2=0x7f5ca80caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80caf50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c430 tx=0x7f5c9800c8f0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 shutdown_connections 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f5c94066530 0x7f5c940689f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ca81539c0 0x7f5ca81e3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ca815d010 0x7f5ca814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 --2- 172.21.15.133:0/578405429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca80c8820 0x7f5ca80caf50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 >> 172.21.15.133:0/578405429 conn(0x7f5ca8066890 msgr2=0x7f5ca80c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 shutdown_connections 2024-01-19T05:02:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.353+0000 7f5cadea5640 1 -- 172.21.15.133:0/578405429 wait complete. 2024-01-19T05:02:28.378 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T05:02:28.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8c27aa640 1 Processor -- start 2024-01-19T05:02:28.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8c27aa640 1 -- start start 2024-01-19T05:02:28.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8c27aa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 0x7fd8bc157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8c27aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc0ca590 con 0x7fd8bc0c7e30 2024-01-19T05:02:28.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8c27aa640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc0c1f00 con 0x7fd8bc0c87c0 2024-01-19T05:02:28.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8c27aa640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc157d10 con 0x7fd8bc14e070 2024-01-19T05:02:28.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8bb7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd8bc0c7e30 0x7fd8bc0c9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40030/0 (socket says 172.21.15.133:40030) 2024-01-19T05:02:28.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.509+0000 7fd8bb7fe640 1 -- 172.21.15.133:0/70378920 learned_addr learned my addr 172.21.15.133:0/70378920 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-19T05:02:28.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.513+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668366710 0 0) 0x7fd8bc0ca590 con 0x7fd8bc0c7e30 2024-01-19T05:02:28.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.513+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a4003530 con 0x7fd8bc0c7e30 2024-01-19T05:02:28.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.513+0000 7fd8bbfff640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 0x7fd8bc157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152722108 0 0) 0x7fd8a4003530 con 0x7fd8bc0c7e30 2024-01-19T05:02:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 msgr2=0x7fd8bc157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:28.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 0x7fd8bc157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 >> v1:172.21.15.156:6789/0 conn(0x7fd8bc0c87c0 legacy=0x7fd8bc161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc157ff0 con 0x7fd8bc0c7e30 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 722969132 0 0) 0x7fd8b0001680 con 0x7fd8bc0c7e30 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 >> v1:172.21.15.133:6789/0 conn(0x7fd8bc0c7e30 legacy=0x7fd8bc0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8a40039b0 0x7fd8a4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a40047d0 0x7fd8a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 0x7fd8a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc157d10 con 0x7fd8a40047d0 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4005580 con 0x7fd8a40039b0 2024-01-19T05:02:28.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a400bed0 con 0x7fd8bc14e070 2024-01-19T05:02:28.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.517+0000 7fd8bbfff640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8a40039b0 0x7fd8a4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:28.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.521+0000 7fd8bb7fe640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a40047d0 0x7fd8a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.521+0000 7fd8bb7fe640 1 -- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 msgr2=0x7fd8a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.521+0000 7fd8bb7fe640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8bc14e070 0x7fd8a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.521+0000 7fd8bb7fe640 1 -- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8a40039b0 msgr2=0x7fd8a4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.521+0000 7fd8bb7fe640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8a40039b0 0x7fd8a4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.521+0000 7fd8bb7fe640 1 -- 172.21.15.133:0/70378920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a4003530 con 0x7fd8a40047d0 2024-01-19T05:02:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.549+0000 7fd8bb7fe640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a40047d0 0x7fd8a4004c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c190 tx=0x7fd8b001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b854c17ea786b5fb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:28.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.613+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0005ae0 con 0x7fd8a40047d0 2024-01-19T05:02:28.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.617+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8b0005c40 con 0x7fd8a40047d0 2024-01-19T05:02:28.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.617+0000 7fd8baffd640 1 -- 172.21.15.133:0/70378920 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00a5870 con 0x7fd8a40047d0 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 -- 172.21.15.133:0/70378920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a40047d0 msgr2=0x7fd8a4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/70378920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a40047d0 0x7fd8a4004c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c190 tx=0x7fd8b001cc00 comp rx=0 tx=0).stop 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c0d47640 1 -- 172.21.15.133:0/70378920 reap_dead start 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 -- 172.21.15.133:0/70378920 shutdown_connections 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 -- 172.21.15.133:0/70378920 >> 172.21.15.133:0/70378920 conn(0x7fd8bc06a660 msgr2=0x7fd8bc06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 -- 172.21.15.133:0/70378920 shutdown_connections 2024-01-19T05:02:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 -- 172.21.15.133:0/70378920 wait complete. 2024-01-19T05:02:28.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.621+0000 7fd8c27aa640 1 Processor -- start 2024-01-19T05:02:28.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 -- start start 2024-01-19T05:02:28.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8a40047d0 0x7fd8bc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8bc151d50 0x7fd8bc1ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 0x7fd8bc14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc157a50 con 0x7fd8bc14ed80 2024-01-19T05:02:28.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1ed190 con 0x7fd8bc151d50 2024-01-19T05:02:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c27aa640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1ece60 con 0x7fd8a40047d0 2024-01-19T05:02:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c0d47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 0x7fd8bc14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c0d47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 0x7fd8bc14f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39548/0 (socket says 172.21.15.133:39548) 2024-01-19T05:02:28.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.625+0000 7fd8c0d47640 1 -- 172.21.15.133:0/1550248197 learned_addr learned my addr 172.21.15.133:0/1550248197 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:28.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.629+0000 7fd8c0d47640 1 -- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8a40047d0 msgr2=0x7fd8bc0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:28.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.629+0000 7fd8c0d47640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8a40047d0 0x7fd8bc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.629+0000 7fd8c0d47640 1 -- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8bc151d50 msgr2=0x7fd8bc1ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:28.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.629+0000 7fd8c0d47640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8bc151d50 0x7fd8bc1ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:28.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.629+0000 7fd8c0d47640 1 -- 172.21.15.133:0/1550248197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc157770 con 0x7fd8bc14ed80 2024-01-19T05:02:28.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.633+0000 7fd8c0d47640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 0x7fd8bc14f210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4004750 tx=0x7fd8b400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:28.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.637+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4005d50 con 0x7fd8bc14ed80 2024-01-19T05:02:28.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.637+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc1f0e00 con 0x7fd8bc14ed80 2024-01-19T05:02:28.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.637+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc1f10e0 con 0x7fd8bc14ed80 2024-01-19T05:02:28.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.637+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc067c50 con 0x7fd8bc14ed80 2024-01-19T05:02:28.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.641+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8b400ced0 con 0x7fd8bc14ed80 2024-01-19T05:02:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.909+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400a880 con 0x7fd8bc14ed80 2024-01-19T05:02:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.909+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8b400aa60 con 0x7fd8bc14ed80 2024-01-19T05:02:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.909+0000 7fd8b8ff9640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd8a8066530 0x7fd8a80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.913+0000 7fd8bbfff640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd8a8066530 0x7fd8a80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.913+0000 7fd8bbfff640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd8a8066530 0x7fd8a80689f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac006e70 tx=0x7fd8ac006dc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.985+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6655+0+0 (secure 0 0 0) 0x7fd8b4054e60 con 0x7fd8bc14ed80 2024-01-19T05:02:28.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:28.985+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8b4050aa0 con 0x7fd8bc14ed80 2024-01-19T05:02:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.157+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8bc074340 con 0x7fd8bc14ed80 2024-01-19T05:02:29.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.917+0000 7fd8b8ff9640 1 -- 172.21.15.133:0/1550248197 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd8b4003d50 con 0x7fd8bc14ed80 2024-01-19T05:02:29.918 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-19T05:02:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd8a8066530 msgr2=0x7fd8a80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd8a8066530 0x7fd8a80689f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac006e70 tx=0x7fd8ac006dc0 comp rx=0 tx=0).stop 2024-01-19T05:02:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 msgr2=0x7fd8bc14f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 0x7fd8bc14f210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4004750 tx=0x7fd8b400cb90 comp rx=0 tx=0).stop 2024-01-19T05:02:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 shutdown_connections 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7fd8a8066530 0x7fd8a80689f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8bc151d50 0x7fd8bc1ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8bc14ed80 0x7fd8bc14f210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 --2- 172.21.15.133:0/1550248197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8a40047d0 0x7fd8bc0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 >> 172.21.15.133:0/1550248197 conn(0x7fd8bc06a660 msgr2=0x7fd8bc0cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 shutdown_connections 2024-01-19T05:02:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:29.921+0000 7fd8c27aa640 1 -- 172.21.15.133:0/1550248197 wait complete. 2024-01-19T05:02:29.949 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-19T05:02:30.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 Processor -- start 2024-01-19T05:02:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 -- start start 2024-01-19T05:02:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c60153760 0x7f6c6006a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6006f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6c60153b40 0x7f6c6006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6015ccb0 con 0x7f6c60153760 2024-01-19T05:02:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6006ac50 con 0x7f6c60153b40 2024-01-19T05:02:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c655be640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600c7ae0 con 0x7f6c600c6870 2024-01-19T05:02:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c5e7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:30.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c5e7fc640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6006f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.133:53162/0 (socket says 172.21.15.133:53162) 2024-01-19T05:02:30.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c5e7fc640 1 -- 172.21.15.133:0/324839018 learned_addr learned my addr 172.21.15.133:0/324839018 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:30.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.077+0000 7f6c5effd640 1 --2- 172.21.15.133:0/324839018 >> v2:172.21.15.133:3300/0 conn(0x7f6c60153760 0x7f6c6006a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:30.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.081+0000 7f6c5f7fe640 1 --2- 172.21.15.133:0/324839018 >> v2:172.21.15.156:3300/0 conn(0x7f6c60153b40 0x7f6c6006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.081+0000 7f6c5effd640 1 -- 172.21.15.133:0/324839018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 msgr2=0x7f6c6006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.081+0000 7f6c5effd640 1 --2- 172.21.15.133:0/324839018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6006f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.081+0000 7f6c5effd640 1 -- 172.21.15.133:0/324839018 >> v2:172.21.15.156:3300/0 conn(0x7f6c60153b40 msgr2=0x7f6c6006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:02:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.081+0000 7f6c5effd640 1 --2- 172.21.15.133:0/324839018 >> v2:172.21.15.156:3300/0 conn(0x7f6c60153b40 0x7f6c6006fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.081+0000 7f6c5effd640 1 -- 172.21.15.133:0/324839018 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600c7dc0 con 0x7f6c60153760 2024-01-19T05:02:30.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.085+0000 7f6c5effd640 1 --2- 172.21.15.133:0/324839018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153760 0x7f6c6006a660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c6006b000 tx=0x7f6c5001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b5acc387ec53f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:30.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.089+0000 7f6c5dffb640 1 -- 172.21.15.133:0/324839018 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500b0440 con 0x7f6c60153760 2024-01-19T05:02:30.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.089+0000 7f6c5dffb640 1 -- 172.21.15.133:0/324839018 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c500b05a0 con 0x7f6c60153760 2024-01-19T05:02:30.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.089+0000 7f6c5dffb640 1 -- 172.21.15.133:0/324839018 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500b0950 con 0x7f6c60153760 2024-01-19T05:02:30.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.089+0000 7f6c655be640 1 -- 172.21.15.133:0/324839018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153760 msgr2=0x7f6c6006a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:30.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.089+0000 7f6c655be640 1 --2- 172.21.15.133:0/324839018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153760 0x7f6c6006a660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c6006b000 tx=0x7f6c5001f0f0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- 172.21.15.133:0/324839018 shutdown_connections 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 --2- 172.21.15.133:0/324839018 >> v2:172.21.15.156:3300/0 conn(0x7f6c60153b40 0x7f6c6006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 --2- 172.21.15.133:0/324839018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6006f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 --2- 172.21.15.133:0/324839018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153760 0x7f6c6006a660 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- 172.21.15.133:0/324839018 >> 172.21.15.133:0/324839018 conn(0x7f6c60072690 msgr2=0x7f6c600cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- 172.21.15.133:0/324839018 shutdown_connections 2024-01-19T05:02:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- 172.21.15.133:0/324839018 wait complete. 2024-01-19T05:02:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 Processor -- start 2024-01-19T05:02:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- start start 2024-01-19T05:02:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c60153760 0x7f6c601ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 0x7f6c601efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c601540f0 con 0x7f6c60153b40 2024-01-19T05:02:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60154c70 con 0x7f6c60153760 2024-01-19T05:02:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c655be640 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6014b980 con 0x7f6c600c6870 2024-01-19T05:02:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c5f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 0x7f6c601efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c5f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 0x7f6c601efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39570/0 (socket says 172.21.15.133:39570) 2024-01-19T05:02:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.093+0000 7f6c5f7fe640 1 -- 172.21.15.133:0/647154888 learned_addr learned my addr 172.21.15.133:0/647154888 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-19T05:02:30.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.097+0000 7f6c5effd640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.097+0000 7f6c5f7fe640 1 -- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 msgr2=0x7f6c6014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.097+0000 7f6c5f7fe640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6014b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.097+0000 7f6c5f7fe640 1 -- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c60153760 msgr2=0x7f6c601ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.097+0000 7f6c5f7fe640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c60153760 0x7f6c601ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.097+0000 7f6c5f7fe640 1 -- 172.21.15.133:0/647154888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009a70 con 0x7f6c60153b40 2024-01-19T05:02:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.101+0000 7f6c5f7fe640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 0x7f6c601efb80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800d500 tx=0x7f6c5800d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.105+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580125f0 con 0x7f6c60153b40 2024-01-19T05:02:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.105+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c58012750 con 0x7f6c60153b40 2024-01-19T05:02:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.105+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58012b20 con 0x7f6c60153b40 2024-01-19T05:02:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c60154340 con 0x7f6c60153b40 2024-01-19T05:02:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c60154900 con 0x7f6c60153b40 2024-01-19T05:02:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60074340 con 0x7f6c60153b40 2024-01-19T05:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.433+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 6) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6c58012c80 con 0x7f6c60153b40 2024-01-19T05:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.433+0000 7f6c577fe640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6c40066580 0x7f6c40068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.433+0000 7f6c5effd640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6c40066580 0x7f6c40068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:02:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.433+0000 7f6c5effd640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6c40066580 0x7f6c40068a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6c500b2000 tx=0x7f6c500aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:02:30.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.461+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f6c58055d60 con 0x7f6c60153b40 2024-01-19T05:02:30.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.461+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6c580519a0 con 0x7f6c60153b40 2024-01-19T05:02:30.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-19T05:02:30.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-19T05:02:30.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-01-19T05:02:30.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-19T05:02:30.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-01-19T05:02:30.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:30.625+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c600cc5b0 con 0x7f6c60153b40 2024-01-19T05:02:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.101+0000 7f6c577fe640 1 -- 172.21.15.133:0/647154888 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6c58054fc0 con 0x7f6c60153b40 2024-01-19T05:02:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data_ec' removed 2024-01-19T05:02:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6c40066580 msgr2=0x7f6c40068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6c40066580 0x7f6c40068a40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6c500b2000 tx=0x7f6c500aa070 comp rx=0 tx=0).stop 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 msgr2=0x7f6c601efb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 0x7f6c601efb80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800d500 tx=0x7f6c5800d9c0 comp rx=0 tx=0).stop 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 shutdown_connections 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:6800/2555181525,v1:172.21.15.156:6801/2555181525] conn(0x7f6c40066580 0x7f6c40068a40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c60153760 0x7f6c601ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c60153b40 0x7f6c601efb80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 --2- 172.21.15.133:0/647154888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c600c6870 0x7f6c6014b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 >> 172.21.15.133:0/647154888 conn(0x7f6c60072690 msgr2=0x7f6c600cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 shutdown_connections 2024-01-19T05:02:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-19T05:02:31.105+0000 7f6c655be640 1 -- 172.21.15.133:0/647154888 wait complete. 2024-01-19T05:02:31.129 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-19T05:02:31.129 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T05:02:31.129 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:31.129 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T05:02:31.129 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-19T05:02:31.129 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:31.129 INFO:tasks.ceph.mds.c:Stopped 2024-01-19T05:02:31.130 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-01-19T05:02:31.130 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:31.130 INFO:tasks.ceph.mds.e:Stopped 2024-01-19T05:02:31.130 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T05:02:31.130 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:31.158 INFO:tasks.ceph.mds.b.smithi156.stderr:2024-01-19T05:02:31.135+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 31547) UID: 0 2024-01-19T05:02:31.159 INFO:tasks.ceph.mds.b.smithi156.stderr:2024-01-19T05:02:31.139+0000 b9ce640 -1 mds.b *** got signal Terminated *** 2024-01-19T05:02:36.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-19T05:02:36.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2024-01-19T05:02:36.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~6s 2024-01-19T05:02:36.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-19T05:02:36.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-01-19T05:02:36.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-01-19T05:02:37.232 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T05:02:37.232 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-19T05:02:37.232 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:37.232 INFO:tasks.ceph.mds.d:Stopped 2024-01-19T05:02:37.232 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-01-19T05:02:37.232 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:37.233 INFO:tasks.ceph.mds.f:Stopped 2024-01-19T05:02:37.233 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-19T05:02:37.233 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-19T05:02:37.233 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:37.234 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-19T05:02:37.237+0000 7f74e4c2a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27404) UID: 0 2024-01-19T05:02:37.234 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-19T05:02:37.237+0000 7f74e4c2a640 -1 osd.0 36 *** Got signal Terminated *** 2024-01-19T05:02:43.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-19T05:02:43.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-01-19T05:02:43.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-01-19T05:02:43.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-19T05:02:43.335 INFO:tasks.ceph.osd.0:Stopped 2024-01-19T05:02:43.336 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-19T05:02:43.336 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:43.337 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-19T05:02:43.336+0000 7fdca93f2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27406) UID: 0 2024-01-19T05:02:43.337 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-19T05:02:43.336+0000 7fdca93f2640 -1 osd.1 38 *** Got signal Terminated *** 2024-01-19T05:02:46.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:02:46.272 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:02:49.134 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:32:36.760 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-19T05:02:49.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-19T05:02:49.179 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:32:36.791 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.186 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:36.796 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.225 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:32:36.852 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.266 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:32:36.878 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.276 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:36.886 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.362 INFO:tasks.ceph.mon.a.smithi133.stderr:==00:00:32:36.989 27294== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.391 INFO:tasks.ceph.mon.c.smithi156.stderr:==00:00:32:37.002 27298== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.421 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:37.031 27299== Warning: unimplemented fcntl command: 1036 2024-01-19T05:02:49.437 INFO:tasks.ceph.osd.1:Stopped 2024-01-19T05:02:49.437 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-19T05:02:49.437 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:49.438 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-19T05:02:49.436+0000 7fad37802640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27408) UID: 0 2024-01-19T05:02:49.438 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-19T05:02:49.436+0000 7fad37802640 -1 osd.2 39 *** Got signal Terminated *** 2024-01-19T05:02:55.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-19T05:02:55.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-19T05:02:55.539 INFO:tasks.ceph.osd.2:Stopped 2024-01-19T05:02:55.539 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-19T05:02:55.539 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:02:55.540 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-19T05:02:55.540+0000 7f6c62e92640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27410) UID: 0 2024-01-19T05:02:55.541 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-19T05:02:55.540+0000 7f6c62e92640 -1 osd.3 40 *** Got signal Terminated *** 2024-01-19T05:03:01.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-19T05:03:01.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-19T05:03:01.641 INFO:tasks.ceph.osd.3:Stopped 2024-01-19T05:03:01.641 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-19T05:03:01.642 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:01.643 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-01-19T05:03:01.639+0000 7f3914d41640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 27694) UID: 0 2024-01-19T05:03:01.643 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-01-19T05:03:01.639+0000 7f3914d41640 -1 osd.4 41 *** Got signal Terminated *** 2024-01-19T05:03:06.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-19T05:03:06.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-19T05:03:07.743 INFO:tasks.ceph.osd.4:Stopped 2024-01-19T05:03:07.743 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-19T05:03:07.743 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:07.744 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-01-19T05:03:07.743+0000 7fd679db2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 27696) UID: 0 2024-01-19T05:03:07.744 INFO:tasks.ceph.osd.5.smithi156.stderr:2024-01-19T05:03:07.743+0000 7fd679db2640 -1 osd.5 42 *** Got signal Terminated *** 2024-01-19T05:03:12.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-19T05:03:12.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-19T05:03:13.844 INFO:tasks.ceph.osd.5:Stopped 2024-01-19T05:03:13.845 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-19T05:03:13.845 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:13.846 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-01-19T05:03:13.843+0000 7f4a153d1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 27700) UID: 0 2024-01-19T05:03:13.846 INFO:tasks.ceph.osd.6.smithi156.stderr:2024-01-19T05:03:13.843+0000 7f4a153d1640 -1 osd.6 43 *** Got signal Terminated *** 2024-01-19T05:03:16.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:16.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:18.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-19T05:03:18.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-19T05:03:19.946 INFO:tasks.ceph.osd.6:Stopped 2024-01-19T05:03:19.947 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-19T05:03:19.947 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:19.948 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-01-19T05:03:19.947+0000 7efcbf91b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 27698) UID: 0 2024-01-19T05:03:19.948 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-01-19T05:03:19.947+0000 7efcbf91b640 -1 osd.7 43 *** Got signal Terminated *** 2024-01-19T05:03:23.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-19T05:03:23.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-19T05:03:26.048 INFO:tasks.ceph.osd.7:Stopped 2024-01-19T05:03:26.048 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-19T05:03:26.049 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-19T05:03:26.049 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:26.075 INFO:tasks.ceph.mgr.y:Stopped 2024-01-19T05:03:26.075 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-19T05:03:26.076 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:26.077 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T05:03:26.074+0000 7f2a5af1a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 27296) UID: 0 2024-01-19T05:03:26.077 INFO:tasks.ceph.mgr.x.smithi156.stderr:2024-01-19T05:03:26.074+0000 7f2a5af1a640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-19T05:03:26.105 INFO:tasks.ceph.mgr.x:Stopped 2024-01-19T05:03:26.106 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-19T05:03:26.106 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-19T05:03:26.106 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:26.162 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-19T05:03:26.132+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27291) UID: 0 2024-01-19T05:03:26.164 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-19T05:03:26.136+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-19T05:03:28.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-19T05:03:28.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-19T05:03:32.207 INFO:tasks.ceph.mon.a:Stopped 2024-01-19T05:03:32.207 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-19T05:03:32.208 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:32.248 INFO:tasks.ceph.mon.b.smithi156.stderr:2024-01-19T05:03:32.214+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 27291) UID: 0 2024-01-19T05:03:32.249 INFO:tasks.ceph.mon.b.smithi156.stderr:2024-01-19T05:03:32.218+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-01-19T05:03:33.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-19T05:03:33.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-01-19T05:03:38.310 INFO:tasks.ceph.mon.b:Stopped 2024-01-19T05:03:38.310 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-19T05:03:38.310 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:03:38.340 INFO:tasks.ceph.mon.c.smithi156.stderr:2024-01-19T05:03:38.310+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 27294) UID: 0 2024-01-19T05:03:38.341 INFO:tasks.ceph.mon.c.smithi156.stderr:2024-01-19T05:03:38.314+0000 a369640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-01-19T05:03:39.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-01-19T05:03:44.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-19T05:03:44.412 INFO:tasks.ceph.mon.c:Stopped 2024-01-19T05:03:44.412 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-19T05:03:44.412 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-01-19T05:03:44.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T05:03:44.431 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-19T05:03:44.670 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T05:03:44.670 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-19T05:03:44.860 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T05:03:44.860 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-19T05:03:45.046 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T05:03:45.046 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-19T05:03:45.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T05:03:45.214 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-19T05:03:45.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T05:03:45.414 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-19T05:03:45.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T05:03:45.581 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-19T05:03:45.741 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T05:03:45.741 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-19T05:03:45.899 INFO:tasks.ceph:Archiving mon data... 2024-01-19T05:03:45.900 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/data/mon.a.tgz 2024-01-19T05:03:45.901 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-01-19T05:03:45.907 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.azkmEG4sHj 2024-01-19T05:03:45.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.azkmEG4sHj 2024-01-19T05:03:46.032 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.azkmEG4sHj 2024-01-19T05:03:46.095 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.azkmEG4sHj is 354KB 2024-01-19T05:03:46.193 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.azkmEG4sHj 2024-01-19T05:03:46.199 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/data/mon.b.tgz 2024-01-19T05:03:46.199 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-01-19T05:03:46.205 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.LF823HeTJk 2024-01-19T05:03:46.205 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LF823HeTJk 2024-01-19T05:03:46.330 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.LF823HeTJk 2024-01-19T05:03:46.395 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.LF823HeTJk is 360KB 2024-01-19T05:03:46.457 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.LF823HeTJk 2024-01-19T05:03:46.462 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/data/mon.c.tgz 2024-01-19T05:03:46.462 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-01-19T05:03:46.511 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.5gRXATrA23 2024-01-19T05:03:46.512 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5gRXATrA23 2024-01-19T05:03:46.637 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.5gRXATrA23 2024-01-19T05:03:46.700 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.5gRXATrA23 is 360KB 2024-01-19T05:03:46.765 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.5gRXATrA23 2024-01-19T05:03:46.770 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-19T05:03:46.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-19T05:03:46.772 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-19T05:03:46.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:46.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:47.205 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-19T05:03:47.467 INFO:tasks.ceph:Archiving crash dumps... 2024-01-19T05:03:47.469 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/remote/smithi133/crash 2024-01-19T05:03:47.469 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-19T05:03:47.483 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/remote/smithi156/crash 2024-01-19T05:03:47.484 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-19T05:03:47.497 INFO:tasks.ceph:Shutting down logrotate 2024-01-19T05:03:47.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:47.529 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:47.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:47.623 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-19T05:03:47.635 INFO:tasks.ceph:Compressing logs... 2024-01-19T05:03:47.635 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-19T05:03:47.669 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-19T05:03:47.686 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-01-19T05:03:47.687 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-01-19T05:03:47.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34962.log 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33091.log 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34962.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gzgzip 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36606.log 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33091.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34962.log.gz 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33772.log 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33091.log.gz 2024-01-19T05:03:47.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-01-19T05:03:47.693 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36606.log.gz 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34435.log 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36658.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33772.log.gz 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34435.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33374.log 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34435.log.gz 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34910.log 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34673.log 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33374.log.gz 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34910.log.gz 2024-01-19T05:03:47.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36294.log 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34673.log.gz 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33832.log 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32659.log 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36294.log.gz/var/log/ceph/ceph-client.admin.33832.log: 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33832.log.gz 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35040.log 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32659.log.gz 2024-01-19T05:03:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.35244.log 2024-01-19T05:03:47.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34040.log 2024-01-19T05:03:47.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35244.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35040.log.gz 2024-01-19T05:03:47.700 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-01-19T05:03:47.700 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34463.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34040.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35244.log.gz 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36450.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.34040.log.gz -5 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33884.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34463.log.gz 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33989.log: /var/log/ceph/ceph-client.admin.33884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36554.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33884.log.gz 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32689.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33936.log 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36554.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-01-19T05:03:47.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32689.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32689.log.gz 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36918.log 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33936.log: /var/log/ceph/ceph-client.admin.36764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34431.log 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz -- replaced with /var/log/ceph/ceph-client.admin.33936.log.gz 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34034.log 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36918.log.gz 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34431.log: /var/log/ceph/ceph-client.admin.34034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27298.log 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34431.log.gz 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.2.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34034.log.gz 2024-01-19T05:03:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36398.log 2024-01-19T05:03:47.703 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.27298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27666.log 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27411.log 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27666.log.gz 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27516.log 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27411.log.gz 2024-01-19T05:03:47.711 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27639.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.5.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27516.log.gz 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27435.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27491.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27639.log.gz 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27435.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27435.log.gz 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27491.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27491.log.gz 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-19T05:03:47.712 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-19T05:03:47.716 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-19T05:03:47.716 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-01-19T05:03:47.716 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-19T05:03:47.716 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-01-19T05:03:47.724 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/mon.c.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-01-19T05:03:47.725 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-01-19T05:03:47.725 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/mds.f.log: 95.2% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-01-19T05:03:47.725 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-01-19T05:03:47.725 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/mds.b.log: 57.8% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-01-19T05:03:47.725 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-01-19T05:03:47.729 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/mds.d.log: 95.5% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-01-19T05:03:47.729 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-19T05:03:47.729 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/mon.b.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-01-19T05:03:47.729 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36398.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.27298.log.gz 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36011.log 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36398.log.gz 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33348.log 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36011.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2024-01-19T05:03:47.731 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33348.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36011.log.gz 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34038.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34261.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33348.log.gz 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34038.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34038.log.gz 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35907.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34261.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34936.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34261.log.gz 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34936.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35907.log.gz 2024-01-19T05:03:47.732 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34856.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34936.log.gz 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34856.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35294.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34856.log.gz/var/log/ceph/ceph-client.admin.34726.log: 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33426.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33746.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36320.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2%/var/log/ceph/ceph-client.admin.33746.log: -- replaced with /var/log/ceph/ceph-client.admin.33426.log.gz 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33692.log 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35294.log.gz 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33746.log.gz 2024-01-19T05:03:47.733 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36320.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36320.log.gz 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32845.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32741.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32845.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33692.log.gz 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34253.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32741.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32845.log.gz 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35014.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32741.log.gz 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34253.log.gz/var/log/ceph/ceph-client.admin.35014.log: 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33858.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36064.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35014.log.gz 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34988.log 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-01-19T05:03:47.734 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33858.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33858.log.gz 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36580.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34988.log.gz 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36241.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36580.log.gz/var/log/ceph/ceph-client.admin.36241.log: 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36476.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36241.log.gz 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34700.log: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35959.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34281.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34543.log 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36476.log.gz 2024-01-19T05:03:47.735 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32905.log 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35959.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34281.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35933.log 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32905.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34543.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 87.7% 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32905.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36684.log 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35933.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34804.log 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35933.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36684.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-01-19T05:03:47.736 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5%/var/log/ceph/ceph-client.admin.34559.log: -- replaced with /var/log/ceph/ceph-client.admin.34804.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34207.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32767.log: /var/log/ceph/ceph-client.admin.34037.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gz 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33962.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35475.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4%/var/log/ceph/ceph-client.admin.33962.log: -- replaced with /var/log/ceph/ceph-client.admin.34207.log.gz 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36840.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33962.log.gz 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.35475.log: /var/log/ceph/ceph-client.admin.36116.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-01-19T05:03:47.737 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32549.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34752.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36840.log.gz 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32793.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34043.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32793.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32549.log.gz 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34236.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32452.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34236.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34043.log.gz 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34236.log.gz 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27534.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35985.log 2024-01-19T05:03:47.738 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5%/var/log/ceph/ceph-client.admin.27534.log: -- replaced with /var/log/ceph/ceph-client.admin.32452.log.gz 2024-01-19T05:03:47.740 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.b.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-19T05:03:47.740 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27540.log 2024-01-19T05:03:47.750 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27534.log.gz 2024-01-19T05:03:47.750 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33505.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33666.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33505.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35985.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33505.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33806.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33666.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33478.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33806.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33806.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33583.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33478.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33478.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33583.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33583.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-19T05:03:47.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22493.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32504.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.tmp-client.admin.22493.log: 88.5% 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22493.log.gz 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33609.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34525.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33609.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32504.log.gz 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33609.log.gz 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34439.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35066.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34525.log.gz 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33294.log 2024-01-19T05:03:47.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34033.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34439.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36997.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34033.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34033.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34030.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.33294.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36997.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36997.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34778.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33452.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34778.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34030.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34778.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35194.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35094.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35194.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33452.log.gz 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33910.log 2024-01-19T05:03:47.753 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35194.log.gz 2024-01-19T05:03:47.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35094.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35094.log.gz 2024-01-19T05:03:47.754 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36736.log 2024-01-19T05:03:47.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34882.log 2024-01-19T05:03:47.755 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-19T05:03:47.755 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.27540.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27540.log.gz 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36736.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33910.log.gz 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36736.log.gz 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36038.log 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34882.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34882.log.gz 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34039.log 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33167.log 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36038.log.gz 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34039.log.gz 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36892.log 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35881.log 2024-01-19T05:03:47.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36892.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-01-19T05:03:47.760 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36892.log.gz 2024-01-19T05:03:47.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-19T05:03:47.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35881.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-19T05:03:47.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35881.log.gz 2024-01-19T05:03:47.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36346.log 2024-01-19T05:03:47.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.c.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-19T05:03:47.761 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27467.log 2024-01-19T05:03:47.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-19T05:03:47.762 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36346.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36346.log.gz 2024-01-19T05:03:47.762 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34830.log 2024-01-19T05:03:47.775 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34229.log 2024-01-19T05:03:47.776 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34830.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34830.log.gz 2024-01-19T05:03:47.780 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27467.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27467.log.gz 2024-01-19T05:03:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33117.log 2024-01-19T05:03:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34229.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34229.log.gz 2024-01-19T05:03:47.788 INFO:teuthology.orchestra.run.smithi156.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-01-19T05:03:47.794 INFO:teuthology.orchestra.run.smithi156.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-19T05:03:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-01-19T05:03:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33117.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33117.log.gz 2024-01-19T05:03:47.820 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-01-19T05:03:47.820 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36528.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-01-19T05:03:47.827 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-01-19T05:03:47.828 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-01-19T05:03:47.842 INFO:teuthology.orchestra.run.smithi133.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-19T05:03:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-01-19T05:03:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/valgrind/mds.a.log: 95.4% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-01-19T05:03:47.847 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-01-19T05:03:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/valgrind/mon.a.log: 91.6% 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-19T05:03:47.849 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-01-19T05:03:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-01-19T05:03:47.850 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36142.log 2024-01-19T05:03:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/valgrind/mds.e.log: 95.4% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-01-19T05:03:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36090.log 2024-01-19T05:03:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36142.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-01-19T05:03:47.854 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36142.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33039.log 2024-01-19T05:03:47.854 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-19T05:03:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36090.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36090.log.gz 2024-01-19T05:03:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32935.log 2024-01-19T05:03:47.856 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32987.log 2024-01-19T05:03:47.856 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33039.log: /var/log/ceph/ceph-client.admin.32935.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33039.log.gz 2024-01-19T05:03:47.857 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32935.log.gz 2024-01-19T05:03:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36814.log 2024-01-19T05:03:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33400.log 2024-01-19T05:03:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32987.log: /var/log/ceph/ceph-client.admin.36814.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32987.log.gz 2024-01-19T05:03:47.858 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36814.log.gz 2024-01-19T05:03:47.858 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36866.log 2024-01-19T05:03:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34647.log 2024-01-19T05:03:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33400.log: /var/log/ceph/ceph-client.admin.36866.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33400.log.gz 2024-01-19T05:03:47.859 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36866.log.gz 2024-01-19T05:03:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33557.log 2024-01-19T05:03:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36424.log 2024-01-19T05:03:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34647.log: /var/log/ceph/ceph-client.admin.33557.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34647.log.gz 2024-01-19T05:03:47.861 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33557.log.gz 2024-01-19T05:03:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32819.log 2024-01-19T05:03:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36215.log 2024-01-19T05:03:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36424.log: /var/log/ceph/ceph-client.admin.32819.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32819.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36424.log.gz 2024-01-19T05:03:47.862 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-19T05:03:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33720.log 2024-01-19T05:03:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32871.log 2024-01-19T05:03:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36215.log: /var/log/ceph/ceph-client.admin.33720.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36215.log.gz 2024-01-19T05:03:47.863 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33720.log.gz 2024-01-19T05:03:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33065.log 2024-01-19T05:03:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32871.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32871.log.gz 2024-01-19T05:03:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33531.log 2024-01-19T05:03:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-01-19T05:03:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33065.log: /var/log/ceph/ceph-client.admin.33531.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz 2024-01-19T05:03:47.866 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33531.log.gz 2024-01-19T05:03:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36710.log 2024-01-19T05:03:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32580.log 2024-01-19T05:03:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.36710.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36710.log.gz 2024-01-19T05:03:47.879 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36168.log 2024-01-19T05:03:47.880 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32580.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-01-19T05:03:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32715.log 2024-01-19T05:03:47.882 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36168.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36168.log.gz 2024-01-19T05:03:47.882 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36502.log 2024-01-19T05:03:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32715.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32715.log.gz 2024-01-19T05:03:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36971.log 2024-01-19T05:03:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36502.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36502.log.gz 2024-01-19T05:03:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36372.log 2024-01-19T05:03:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36971.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36971.log.gz 2024-01-19T05:03:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-01-19T05:03:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36372.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36372.log.gz 2024-01-19T05:03:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27415.log 2024-01-19T05:03:47.889 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.36944.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-01-19T05:03:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.27415.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27415.log.gz 2024-01-19T05:03:48.016 INFO:teuthology.orchestra.run.smithi156.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-19T05:03:48.206 INFO:teuthology.orchestra.run.smithi156.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-19T05:03:48.517 INFO:teuthology.orchestra.run.smithi156.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-19T05:03:49.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-01-19T05:03:49.185 INFO:teuthology.orchestra.run.smithi133.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-19T05:03:49.783 INFO:teuthology.orchestra.run.smithi156.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-19T05:03:50.375 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-19T05:03:50.422 INFO:teuthology.orchestra.run.smithi156.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-19T05:03:50.434 INFO:teuthology.orchestra.run.smithi156.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-19T05:03:50.485 INFO:teuthology.orchestra.run.smithi156.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-19T05:03:50.487 INFO:teuthology.orchestra.run.smithi156.stderr: 2024-01-19T05:03:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m2.804s 2024-01-19T05:03:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:user 0m11.581s 2024-01-19T05:03:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m0.451s 2024-01-19T05:03:50.635 INFO:teuthology.orchestra.run.smithi133.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-19T05:03:51.031 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-19T05:03:51.601 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-19T05:03:52.993 INFO:teuthology.orchestra.run.smithi133.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.35475.log.gz 2024-01-19T05:03:58.364 INFO:teuthology.orchestra.run.smithi133.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-01-19T05:03:58.365 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-19T05:03:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m10.695s 2024-01-19T05:03:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m29.484s 2024-01-19T05:03:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.996s 2024-01-19T05:03:58.366 INFO:tasks.ceph:Archiving logs... 2024-01-19T05:03:58.366 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/remote/smithi133/log 2024-01-19T05:03:58.367 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-19T05:04:02.267 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/remote/smithi156/log 2024-01-19T05:04:02.268 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-19T05:04:03.753 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-19T05:04:03.754 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-19T05:04:03.764 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-19T05:04:03.764 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-19T05:04:03.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-19T05:04:03.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-19T05:04:03.841 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-19T05:04:03.850 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-19T05:04:03.850 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T05:04:03.853 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T05:04:03.863 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T05:04:03.863 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2024-01-19T05:04:03.863 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u 53 128 377 0.067 -2.088 0.382 2024-01-19T05:04:03.863 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 128 377 0.097 -2.069 0.317 2024-01-19T05:04:03.863 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 110 128 377 0.086 -2.175 0.180 2024-01-19T05:04:03.863 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-19T05:04:03.865 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T05:04:03.866 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2024-01-19T05:04:03.866 INFO:teuthology.orchestra.run.smithi156.stdout:*hv01.front.sepi 44.4.53.2 2 u 46 64 377 0.079 -1.852 0.203 2024-01-19T05:04:03.866 INFO:teuthology.orchestra.run.smithi156.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.080 -1.176 0.176 2024-01-19T05:04:03.866 INFO:teuthology.orchestra.run.smithi156.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 64 377 0.089 -1.362 0.179 2024-01-19T05:04:03.866 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-19T05:04:03.867 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-19T05:04:03.875 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-19T05:04:03.875 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-19T05:04:03.884 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-19T05:04:03.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-19T05:04:03.926 INFO:teuthology.task.internal:Duration was 2952.684942 seconds 2024-01-19T05:04:03.927 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-19T05:04:03.935 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-19T05:04:03.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-19T05:04:03.938 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-19T05:04:03.975 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-19T05:04:03.975 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-01-19T05:04:03.975 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-19T05:04:04.024 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2024-01-19T05:04:04.025 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-19T05:04:04.034 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-19T05:04:04.035 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-19T05:04:04.069 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-19T05:04:04.103 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-19T05:04:04.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-19T05:04:04.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-19T05:04:04.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-19T05:04:04.214 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-19T05:04:04.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-19T05:04:04.225 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-19T05:04:04.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-19T05:04:04.248 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:04:04.269 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:04:04.276 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-01-19T05:04:04.289 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2024-01-19T05:04:04.316 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:04:04.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:04:04.335 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:04:04.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:04:04.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-19T05:04:04.373 INFO:teuthology.task.internal:Transferring archived files... 2024-01-19T05:04:04.374 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/remote/smithi133 2024-01-19T05:04:04.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-19T05:04:04.400 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997/remote/smithi156 2024-01-19T05:04:04.400 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-19T05:04:04.426 INFO:teuthology.task.internal:Removing archive directory... 2024-01-19T05:04:04.426 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-19T05:04:04.441 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-19T05:04:04.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-19T05:04:04.479 INFO:teuthology.task.internal:Not uploading archives. 2024-01-19T05:04:04.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-19T05:04:04.532 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-19T05:04:04.533 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-19T05:04:04.535 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-19T05:04:04.539 INFO:teuthology.orchestra.run.smithi133.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 19 05:04 /home/ubuntu/cephtest 2024-01-19T05:04:04.542 INFO:teuthology.orchestra.run.smithi156.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 19 05:04 /home/ubuntu/cephtest 2024-01-19T05:04:04.543 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-19T05:04:04.553 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-19T05:04:04.563 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-19T05:04:04.563 INFO:teuthology.nuke:Checking targets against current locks 2024-01-19T05:04:04.586 DEBUG:teuthology.nuke:shortname: smithi133 2024-01-19T05:04:04.586 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:04:04.608 DEBUG:teuthology.nuke:shortname: smithi156 2024-01-19T05:04:04.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:04:04.611 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:06:04.822761', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKl0Q+xC6TnJKR6NvnrNEOAuT+b5nfOqItDsKCd1YHs7HCzF1zWbQmAkVdX8PQKFrvJUEvNLs0gv/l+XFF3Je6k='} 2024-01-19T05:04:04.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520997', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:06:04.821335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuB7JWfd3WQcQkOFKGQLetrP1fsVFkZ2HXq4LEtrduNA9tmMQOkalCgv1HcsK8/Jlr+pnNsg2yBh/cxozRnb1M='} 2024-01-19T05:04:04.659 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-19T05:04:04.660 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T05:04:04.694 INFO:teuthology.orchestra.console.smithi156:Power off 2024-01-19T05:04:04.694 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T05:04:04.705 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-19T05:04:04.705 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:04.720 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-01-19T05:04:04.720 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:04.729 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-19T05:04:04.747 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-01-19T05:04:08.730 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:08.748 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:08.840 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-19T05:04:08.857 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-01-19T05:04:12.843 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:12.858 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:12.954 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-19T05:04:12.969 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-01-19T05:04:13.055 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-19T05:04:16.972 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:04:17.082 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-01-19T05:04:17.182 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-01-19T05:04:17.286 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 2952.684942007065 failure_reason: 'valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-01-19T05:04:17.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:04:17.364 INFO:teuthology.run:FAIL